Interaction method based on multimedia programs and terminal device

ABSTRACT

An interaction method based on multimedia programs, a terminal device, a server and a system are disclosed, which belong to the field of network technologies. The method includes: acquiring at least one image clip information of a multimedia program in a process of playing back the multimedia program; sending the image clip information, the image clip information being used for matching corresponding multimedia program information; receiving interaction information corresponding to the multimedia program information; and outputting an interactive interface, to interact with the multimedia program based on an interaction operation on the interactive interface. The present disclosure is easy to operate, and improves interaction efficiency.

CROSS REFERENCE TO RELATED APPLICATIONS

This is a continuation application of International Patent ApplicationNo. PCT/CN2015/081190, filed on Jun. 10, 2015, which claims priority toChinese Patent Application No. 201410265804.4 filed on Jun. 13, 2014,the disclosure of which is incorporated by reference herein in itsentirety.

FIELD OF THE TECHNOLOGY

The present disclosure relates to the field of network technologies, andin particular, to an interaction method based on multimedia programs, aterminal device, a server and a system.

BACKGROUND OF THE DISCLOSURE

In order to enhance communications between users, a program producer mayconfigure an interactive program in the middle of a program, to guidethe users to participate in interaction. By taking that the producer isa TV station as an example, the TV station may insert an interactiveprogram in the middle of a program, the interactive program prompts theusers to send short messages to a specified number or leave a message ata specified website in manners such as presenter broadcast and textbroadcast.

In the interaction manners, the users can send short messages or leave amessage at a specified website only by performing operations of editingtext, the operations are too tedious, and interaction efficiency is verylow.

SUMMARY

In view of the above, embodiments of the present invention provide aninteraction method based on multimedia programs, a terminal device, aserver and a system. The technical solutions are as follows:

An interaction method based on multimedia programs, the methodincluding:

acquiring at least one image clip information of a multimedia program ina process of playing back the multimedia program;

sending the image clip information, the image clip information beingused for matching corresponding multimedia program information;

receiving interaction information corresponding to the multimediaprogram information; and

outputting an interactive interface, to interact with the multimediaprogram based on an interaction operation on the interactive interface.

An interaction method based on multimedia programs, the methodincluding:

receiving image clip information of a multimedia program, the image clipinformation being acquired in a process of playing back the multimediaprogram;

determining multimedia program information matching the image clipinformation according to the image clip information;

acquiring interaction information corresponding to the multimediaprogram information; and

sending the interaction information.

An interaction method based on multimedia programs, the methodincluding:

acquiring, by a terminal device, at least one image clip information ofa multimedia program in a process of playing back the multimediaprogram;

sending, by the terminal device, the image clip information to a server,the image clip information being used for matching correspondingmultimedia program information;

when receiving the image clip information, determining, by the server,multimedia program information matching the image clip informationaccording to the image clip information, and acquiring interactioninformation corresponding to the multimedia program information;

sending, by the server, the interaction information to the terminaldevice; and

when receiving the interaction information, outputting, by the terminaldevice, an interactive interface, to interact with the multimediaprogram based on an interaction operation on the interactive interface.

A terminal device, the terminal device including:

an image clip information acquisition module, configured to acquire atleast one image clip information of a multimedia program in a process ofplaying back the multimedia program;

an image clip information sending module, configured to send the imageclip information, the image clip information being used for matchingcorresponding multimedia program information;

an interaction information receiving module, configured to receiveinteraction information corresponding to the multimedia programinformation; and

an interaction module, configured to output an interactive interface, tointeract with the multimedia program based on an interaction operationon the interactive interface.

According to the methods, the terminal device, the server and the systemin the embodiments of the present invention, at least one image clipinformation of a multimedia program is acquired in a process of playingback the multimedia program, the image clip information being used formatching corresponding multimedia program information, interactioninformation corresponding to the multimedia program information isreceived, an interactive interface is output, and interaction with themultimedia program is performed based on an interaction operation on theinteractive interface. As participation in interaction can be done by asimple interaction operation on the interactive interface, the operationis easy, thereby improving interaction efficiency.

BRIEF DESCRIPTION OF THE DRAWINGS

To describe the technical solutions of the embodiments of the presentinvention more clearly, the following briefly introduces theaccompanying drawings required for describing the embodiments.Apparently, the accompanying drawings in the following description showonly some embodiments of the present invention, and a person of ordinaryskill in the art may still derive other drawings from these accompanyingdrawings without creative efforts.

FIG. 1 is a schematic structural diagram of an interaction system basedon multimedia programs according to one embodiment of the presentinvention;

FIG. 2 is a flowchart of an interaction method based on multimediaprograms according to one embodiment of the present invention;

FIG. 3 is a flowchart of an interaction method based on multimediaprograms according to one embodiment of the present invention;

FIG. 4A is a flowchart of an interaction method based on multimediaprograms according to one embodiment of the present invention;

FIG. 4B is a schematic diagram of a function option interface accordingto one embodiment of the present invention;

FIG. 4C is a schematic diagram of a scan interface according to oneembodiment of the present invention;

FIG. 4D is a schematic diagram of a shake interface according to oneembodiment of the present invention;

FIG. 4E is a schematic diagram of a vote interface according to oneembodiment of the present invention;

FIG. 5A is a flowchart of an interaction method based on multimediaprograms according to one embodiment of the present invention;

FIG. 5B is a schematic diagram of an interactive quiz interfaceaccording to one embodiment of the present invention;

FIG. 6A is a flowchart of an interaction method based on multimediaprograms according to one embodiment of the present invention;

FIG. 6B is a schematic diagram of an answer interface according to oneembodiment of the present invention;

FIG. 6C is a schematic diagram of another answer interface according toone embodiment of the present invention;

FIG. 7A is a flowchart of an interaction method based on multimediaprograms according to one embodiment of the present invention;

FIG. 7B is a schematic diagram of a lottery interface according to oneembodiment of the present invention;

FIG. 8A is a flowchart of an interaction method based on multimediaprograms according to one embodiment of the present invention;

FIG. 8B is a schematic diagram of a comment interface according to oneembodiment of the present invention;

FIG. 9A is a flowchart of an interaction method based on multimediaprograms according to one embodiment of the present invention;

FIG. 9B is a schematic diagram of a target display interface accordingto one embodiment of the present invention;

FIG. 9C is a schematic diagram of a value transfer interface accordingto one embodiment of the present invention;

FIG. 10A is a flowchart of an interaction method based on multimediaprograms according to one embodiment of the present invention;

FIG. 10B is a schematic diagram of a session interface according to oneembodiment of the present invention;

FIG. 10C is a schematic diagram of a details interface according to oneembodiment of the present invention;

FIG. 11A is a flowchart of an interaction method based on multimediaprograms according to one embodiment of the present invention;

FIG. 11B is a schematic diagram of a multimedia display interfaceaccording to one embodiment of the present invention;

FIG. 12 is a schematic structural diagram of a terminal device accordingto one embodiment of the present invention;

FIG. 13 is a schematic structural diagram of a terminal device accordingto one embodiment of the present invention;

FIG. 14 is a schematic structural diagram of a server according to oneembodiment of the present invention;

FIG. 15 is a schematic structural diagram of a server according to oneembodiment of the present invention; and

FIG. 16 is a schematic structural diagram of an interaction system basedon multimedia programs according to one embodiment of the presentinvention.

DESCRIPTION OF EMBODIMENTS

The following clearly and completely describes the technical solutionsin the embodiments of the present invention with reference to theaccompanying drawings in the embodiments of the present invention.Apparently, the described embodiments are some of the embodiments of thepresent invention rather than all of the embodiments. All otherembodiments obtained by a person of ordinary skill in the art based onthe embodiments of the present invention without creative efforts shallfall within the protection scope of the present disclosure.

FIG. 1 is a schematic structural diagram of an interaction system basedon multimedia programs according to one embodiment of the presentinvention. Referring to FIG. 1, the interaction system includes: aterminal device and a server, and the server and the terminal device areconnected through a network.

The terminal device is configured to acquire at least one image clipinformation of a multimedia program in a process of playing back themultimedia program, and send the image clip information to the server,the image clip information being used for matching correspondingmultimedia program information. The server is configured to, whenreceiving the image clip information, determine multimedia programinformation matching the image clip information according to the imageclip information, acquire interaction information corresponding to themultimedia program information, and send the interaction information tothe terminal device. The terminal device is further configured toreceive the interaction information, and output an interactiveinterface, to interact with the multimedia program based on aninteraction operation on the interactive interface.

A device playing back the multimedia program is referred to as aplayback device, the terminal device may be a device integrated with theplayback device, that is, the terminal device can play back themultimedia program and can also acquire at least one image clipinformation of the multimedia program in the process of playing back themultimedia program, the terminal device may be a smart TV integratedwith a set-top box or a smart TV set-top box, etc., and a user cancontrol the terminal device by using a remote control or a key providedby the terminal device. The terminal device may also be a deviceindependent of the playback device, and in the process that the playbackdevice plays back the multimedia program, the terminal device mayacquire at least one image clip information of the multimedia program.For example, the playback device is a smart TV or a smart TV set-topbox, and the terminal device is a smart phone or a tablet computer orthe like. The embodiment of the present invention does not limit theterminal device and the playback device.

Referring to FIG. 1, when the playback device is the smart TV, theterminal device may be the smart TV per se or the set-top box, and mayalso be the smart phone.

FIG. 2 is a flowchart of an interaction method based on multimediaprograms according to one embodiment of the present invention. Anexecution body of the embodiment of the present invention is a terminaldevice; referring to FIG. 2, the method includes:

201. Acquire at least one image clip information of a multimedia programin a process of playing back the multimedia program.

202. Send the image clip information, the image clip information beingused for matching corresponding multimedia program information.

203. Receive interaction information corresponding to the multimediaprogram information.

204. Output an interactive interface, to interact with the multimediaprogram based on an interaction operation on the interactive interface.

According to the method in the embodiment of the present invention, atleast one image clip information of a multimedia program is acquired ina process of playing back the multimedia program, the image clipinformation being used for matching corresponding multimedia programinformation, interaction information corresponding to the multimediaprogram information is received, an interactive interface is output, andinteraction with the multimedia program is performed based on aninteraction operation on the interactive interface. As participation ininteraction can be done by a simple interaction operation on theinteractive interface, the operation is easy, thereby improvinginteraction efficiency.

The acquiring at least one image clip information of a multimediaprogram includes:

scanning a display screen where the multimedia program is played, toobtain the at least one image clip information of the multimediaprogram.

The outputting an interactive interface, to interact with the multimediaprogram based on an interaction operation on the interactive interfaceincludes:

when the interaction information includes multiple candidate options,outputting an interactive interface at least including the multiplecandidate options, and when a selection operation on a specifiedcandidate option in the interactive interface is detected, sending thespecified candidate option.

The outputting an interactive interface, to interact with the multimediaprogram based on an interaction operation on the interactive interfaceincludes:

when the interaction information includes prompt information, outputtingan interactive interface at least including the prompt information andan input field, acquiring response information input in the input field,and sending the response information.

The outputting an interactive interface, to interact with the multimediaprogram based on an interaction operation on the interactive interfaceincludes:

when the interaction information includes lottery information,outputting an interactive interface at least including the lotteryinformation, receiving a lottery result, and displaying the lotteryresult in the lottery interface.

The outputting an interactive interface, to interact with the multimediaprogram based on an interaction operation on the interactive interfaceincludes:

when the interaction information includes a target value, outputting atarget display interface at least including the target value and anexchange option, if a click operation on the exchange option isdetected, outputting a value transfer interface at least including thetarget value and a value transfer option, and if a click operation onthe value transfer option is detected, sending a value transfer requestfor the target; or

when the interaction information includes a target value, outputting avalue transfer interface at least including the target value and a valuetransfer option, and if a click operation on the value transfer optionis detected, sending a value transfer request for the target.

The outputting an interactive interface, to interact with the multimediaprogram based on an interaction operation on the interactive interfaceincludes:

when the interaction information is a first user ID and an instructionof calling an instant messaging (IM) session window, judging whether auser relation chain of a second user ID used by the terminal deviceincludes the first user ID;

when the user relation chain of the second user ID includes the firstuser ID, outputting an interactive interface at least including an IMsession window of the second user ID and the first user ID, acquiring IMmessages input in the IM session window, and sending the IM messagesbased on the second user ID; or

when the user relation chain of the second user ID does not include thefirst user ID, outputting an interactive interface at least includingdetails information and an attention option of the first user ID, and ifa click operation on the attention option in the interactive interfaceis detected, sending an attention request for the first user ID.

The outputting an interactive interface, to interact with the multimediaprogram based on an interaction operation on the interactive interfaceincludes:

when the interaction information is multimedia program information,outputting an interactive interface at least including the multimediaprogram information, the interactive interface being configured todisplay the multimedia program information.

All the above optional technical solutions can form optional embodimentsof the present invention in any combination, which are not repeatedherein one by one.

FIG. 3 is a flowchart of an interaction method based on multimediaprograms according to one embodiment of the present invention. Anexecution body of the embodiment of the present invention is a server;referring to FIG. 3, the method includes:

301. Receive image clip information of a multimedia program, the imageclip information being acquired in a process of playing back themultimedia program.

302. Determine multimedia program information matching the image clipinformation according to the image clip information.

303. Acquire interaction information corresponding to the multimediaprogram information.

304. Send the interaction information.

According to the method in the embodiment of the present invention, aserver, when receiving image clip information of a multimedia program,returns interaction information corresponding to the multimedia programinformation to the terminal device, to cause the terminal device tooutput an interactive interface, so as to interact with the multimediaprogram based on an interaction operation on the interactive interface.As participation in interaction can be done by a simple interactionoperation on the interactive interface, the operation is easy, therebyimproving interaction efficiency.

The determining multimedia program information matching the image clipinformation according to the image clip information includes:

traversing image information of each multimedia program stored,determining the image information matching the image clip information,and determining multimedia program information of the matched imageinformation.

Before the determining multimedia program information matching the imageclip information according to the image clip information, the methodfurther includes:

taking a screenshot of each multimedia program, to obtain a plurality ofimage information.

After the sending the interaction information, the method furtherincludes:

when the interaction information includes multiple candidate options, ifa specified candidate option is received, increasing the number of thespecified candidate option; or

when the interaction information includes multiple candidate options, ifa specified candidate option is received, judging whether the specifiedcandidate option is correct, and sending virtual reward data accordingto a judgment result.

After the sending the interaction information, the method furtherincludes:

when the interaction information includes prompt information, ifresponse information is received, judging whether the responseinformation is correct, and sending virtual reward data according to ajudgment result; or

when the interaction information includes prompt information, ifresponse information is received, releasing the response information; orwhen the interaction information is lottery information, acquiring alottery result corresponding to the lottery information, and sending thelottery information.

After the sending the interaction information, the method furtherincludes:

when the interaction information includes a target value, if a valuetransfer request for the target is received, performing a value transferoperation according to the value, account information corresponding tothe target and account information corresponding to a terminal devicethat sends the value transfer request.

After the sending the interaction information, the method furtherincludes:

when the interaction information is a first user ID and an instructionof calling an IM session window, if an IM message is received, sendingthe IM message to a terminal device where the first user ID is; or

when the interaction information is a first user ID and an instructionof calling an IM session window, if an attention request sent by aterminal device is received, adding the first user ID to a user relationchain of the terminal device.

All the above optional technical solutions can form optional embodimentsof the present invention in any combination, which are not repeatedherein one by one.

In the embodiment of the present invention, the image clip informationmay include vote-related content, for example, vote for each singer in asinger contest; or include interactive quiz-related content, forexample, predict the outcome of an ongoing game; or includeexchange-target-related content, for example, recommend goods that arebeing sold; or include character-related content, for example, a starinterviewed in a star talk show or the like. For the image clipinformation including different content, the interaction informationacquired by the server is different, an interaction form between theterminal device and the server is different, the interaction form refersto the type of information sent by the terminal device to the serverbased on an interaction operation on the interactive interface and thetype of information returned by the server to the terminal device, andthe interaction form includes, but is not limited to, vote, interactivequiz, lottery, exchange target, target value transfer and the like. Forease of description, interaction methods based on multimedia programscorresponding to different image clip information are specificallydescribed below in combination with the content and the interactionsystem in the foregoing embodiments.

FIG. 4A is a flowchart of an interaction method based on multimediaprograms according to one embodiment of the present invention.Interaction bodies in the embodiment of the present invention are aterminal device and a server; for ease of description, the embodiment ofthe present invention takes that the image clip information includesvote-related content as an example, and interaction informationcorresponding to the image clip information is vote informationincluding multiple candidate options; referring to FIG. 4A, the methodincludes:

401. A terminal device acquires at least one image clip information of amultimedia program in a process of playing back the multimedia program.

The terminal device may be a device integrated with the playback deviceor a device independent of the playback device. When the terminal deviceis a device independent of the playback device, the terminal device andthe playback device achieve dual-screen interaction, when users vote onthe terminal device, the playback device may continue to play back themultimedia program, continuity is strong, and it is unnecessary tointerrupt the process that the users watch the multimedia program,thereby increasing the number of users participating in the interactionand enhancing user viscosity.

In addition, the server provides a multimedia program for the playbackdevice, the playback device can download the multimedia program from theserver, and plays back the downloaded multimedia program offline, or theplayback device can send a request for playing back the multimediaprogram online to the server, the server, when receiving the request,compresses the multimedia program, to obtain a streaming media file, andsends the streaming media file to the playback device, and the playbackdevice, when receiving the streaming media file, caches the streamingmedia file and then can play back the streaming media file. When theserver compresses a network video file, the streaming media fileobtained is video streaming, and when the server compresses a networkaudio file, the streaming media file obtained is audio streaming.

In the process of playing back the multimedia program, users canactively use the terminal device to acquire image clip information ofthe multimedia program. However, in order to increase the number of userparticipating in interaction, when an activity organizer launches aninteractive activity, the server can previously insert a clip multimediaprogram configured to prompt users to participate in interaction intothe multimedia program, when playback comes to the clip multimediaprogram, the users are prompted to participate in interaction, and atthis time, the users can use the terminal device to acquire image clipinformation of the clip multimedia program as prompted. Afterwards, whenthe activity organizer wishes to end the interactive activity, theserver can delete the clip multimedia program from the multimediaprogram.

Different from interactive programs real-time played back at the TVstation, the multimedia program can be played back repeatedly, each timethe multimedia program is played back, users can be guided toparticipate in interaction, which prolongs the effective time ofprompting the users, increases the number of users participating ininteraction and enhances user viscosity.

Specifically, in the process of playing back the multimedia program, theterminal device scans the display screen through a scan interfaceprovided by a specified function application, to obtain imageinformation of the multimedia program.

In the embodiment of the present invention, the terminal device may beinstalled with a specified function application, and the specifiedfunction application is configured to acquire image clip information ofa multimedia program being played back, and send the image clipinformation to the server. During running of the specified functionapplication, the terminal device scans a display screen on which amultimedia program is being played back through a scan interfaceprovided by the specified function application, and at this time, theterminal device can obtain image information being played back on thedisplay screen, that is, image clip information of the multimediaprogram. The specified function application may be an IM application, aninformation display application or an application specificallyconfigured to acquire image clip information on TVs or the like, whichis not limited in the embodiment of the present invention.

Referring to FIG. 4B, by taking that the playback device is a smart TVand the terminal device is a smart phone as an example, in the processthat the smart TV plays back the multimedia program, the terminal devicecan open a function option interface provided by an IM application, whenthe terminal device detects a user's click operation on a “scan a QRcode” function option, a scan interface as shown in FIG. 4C isdisplayed, the scan interface including a scan box, at this time, a usercan align a camera of the terminal device with a display screen of thesmart TV, to make the display screen of the smart TV project into thescan box, and the terminal device scans the display screen to obtainimage clip information of the multimedia program, so that the terminaldevice acquires interaction information corresponding to the multimediaprogram according to the image clip information subsequently, and theoperation is simple and quick.

In the embodiment of the present invention, the terminal device may scanthe display screen once, to obtain one image clip information, and mayscan the display screen multiple times, to obtain a plurality of imageclip information. The terminal device pre-determines the number ofscanning, and when determining that scanning comes to the displayscreen, performs scanning according to the number of scanning, to obtainimage clip information corresponding to the number of scanning. Further,the terminal device pre-determines the number of scanning and a scanfrequency, when determining that scanning comes to the display screen,performs scanning according to the scan frequency, and stops scanninguntil acquiring image clip information corresponding to the number ofscanning. The embodiment of the present invention does not define thenumber of the image clip information.

In the embodiment of the present invention, the multimedia program maybe a video program or an audio program, and correspondingly, theterminal device may acquire image clip information of the multimediaprogram or may acquire video clip information or audio clip informationof the multimedia program, which is not limited in the embodiment of thepresent invention.

Further, when the type of the clip information varies, the terminaldevice acquires the clip information in a different manner.Correspondingly, step 401 may be replaced with step 401 a:

401 a. In the process of playing back a multimedia program, when theterminal device receives a shake instruction during running of aspecified function of the specified function application, video clipinformation or audio clip information of the multimedia program isrecorded.

In order to prevent that a shake instruction for implementing anotherfunction is mistakenly identified as the shake instruction for recordingvideo information or audio information in the embodiment of the presentinvention, the terminal device receives the shake instruction duringrunning of a specified function of the specified function application.The specified function may be a shake function of the specified functionapplication or a playback device shake function of the specifiedfunction application or the like, the terminal device waits forreceiving the shake instruction when opening the specified function, andthe terminal device records video clip information or audio clipinformation of the playback device when receiving the shake instruction,that is, when the multimedia program is a video program, video clipinformation or audio clip information of the video program is recorded,and when the multimedia program is an audio program, audio clipinformation of the audio program is recorded.

When receiving the shake instruction, the terminal device begins torecord video information or audio information of the multimedia program,and ends recording when a recording duration reaches a first specifiedduration, to obtain recorded video clip information or audio clipinformation. The first specified duration may be 2 s, 3 s or anotherduration, may be pre-determined by the user, or may be determined andsent to the terminal device by the server, which is not limited in theembodiment of the present invention.

Referring to FIG. 4B, in the process that the playback device plays backthe multimedia program, the terminal device can open a function optioninterface provided by the IM application, and the terminal device, whendetecting a user's click operation on a “shake it off” function option,opens the shake function, and displays a shake interface as shown inFIG. 4D, to wait for receiving a shake instruction. When a user shakesthe terminal device, the terminal device receives the shake instructionand records the video clip information or audio clip information, sothat the terminal device acquires interaction information correspondingto the video clip information or audio clip information subsequently,and the operation is simple and quick.

402. The terminal device sends the image clip information to the server.In order to acquire interaction information corresponding to the clipinformation, the terminal device sends the image clip information to theserver.

The terminal device sends the image clip information to the server basedon a user ID, so that the server returns interaction informationcorresponding to the image clip information based on the user ID. Theuser ID may be a user account, a mobile phone number or a terminaldevice number, etc., which is not limited in this embodiment of thepresent invention.

403. The server, when receiving the image clip information, determinesmultimedia program information matching the image clip informationaccording to the image clip information, and acquires interactioninformation corresponding to the multimedia program information, theinteraction information being vote information including multiplecandidate options.

In the embodiment of the present invention, the image clip informationacquired by the terminal device includes vote-related content, forexample, the image clip information may include a keyword “vote” andnames, pictures, numbers and the like of various candidate options, forexample, image clip information in a singer contest program may includea keyword “vote” and pictures and numbers of various candidate singers.In addition, when the clip information acquired by the terminal deviceis video clip information, the video clip information may also include akeyword “vote” and names, pictures, numbers and the like of variouscandidate options, and when the clip information acquired by theterminal device is audio clip information, the audio clip informationmay include broadcast “vote” as well as names of multiple candidateoptions, and one clip of audio of each candidate option and the like.For example, audio information in a singer contest program may includebroadcast “vote” and names and songs of various candidate singers.

In the embodiment of the present invention, the server storesinteraction information corresponding to the multimedia programinformation, and the interaction information may be set by the serveraccording to the multimedia program, or set according to an interactiveactivity currently initiated. The multimedia program informationincludes the name, maker, broadcast time and other information of themultimedia program, which is not limited in the embodiment of thepresent invention.

Specifically, for each multimedia program, the server takes a screenshotof the multimedia program, to obtain a plurality of image information,acquires interaction information corresponding to the multimedia programinformation, and correspondingly stores the multimedia programinformation, the plurality of image information and the interactioninformation. The server can take a screenshot of the multimedia programaccording to a specified frequency, to obtain a plurality of imageinformation.

Further, the server identifies each obtained image information, acquireskey picture, keyword, key string and other information included in eachimage information, determines interaction information corresponding toeach image information according to the key picture, keyword, key stringand other information included in each image information, andcorrespondingly stores the image information, the key picture, keyword,key string and other information included in the image information andthe interaction information. The key picture may be human face pictures,two-dimensional code pictures and the like appearing in the imageinformation, the keyword may be text appearing in the image information,and the key string may be a numeric string or English words and the likeappearing in the image information.

By taking the vote information in the embodiment of the presentinvention as an example, when the server acquires the keyword “vote” andacquires a plurality of human face pictures after identifying the imageinformation, interaction information corresponding to the imageinformation is determined as vote information including candidatescorresponding to the plurality of human face pictures.

Correspondingly, step 403 may include the following step 403 a:

403 a. The server, when receiving the image clip information, traverseseach stored image information, determines the image information matchingthe image clip information, determines multimedia program information ofthe matched image information, and acquires interaction informationcorresponding to the multimedia program information.

For each stored image information, the server judges whether the imageinformation matches the image clip information through imagerecognition, determines that the image information matches the imageclip information when the image information is the same as the imageclip information, or determines that the image information matches theimage clip information when similarity between the image information andthe image clip information exceeds a first specified threshold. At thistime, the server determines multimedia program information of the imageinformation, acquires interaction information corresponding to themultimedia program information, and returns the interaction informationto the terminal device. The first specified threshold can be set by atechnician during development, which is not limited in the embodiment ofthe present invention.

Further, for each stored image information, when the server stores thekey picture, keyword, key string and other information included in theimage information, the server identifies the clip information, toacquire clip picture, clip keyword or clip key string and otherinformation included in the clip information, when any one of the keypicture, keyword, key string and other information included in the imageinformation is the same as any one of the clip picture, clip keyword orclip key string and other information included in the image clipinformation, it can be determined that the image information matches theimage clip information, or, when all the key picture, keyword, keystring and other information included in the image information are thesame as the clip picture, clip keyword or clip key string and otherinformation included in the image clip information, it is determinedthat the image information matches the image clip information.

For example, for each image information stored by the server, the serverobtains keywords included in the image information previously throughkeyword recognition. When receiving the image clip information, theserver identifies the image clip information and obtains names ofcandidate singers, and the server judges whether the keywords includedin the image information include the names of the candidate singers, ifyes, determines that the image information matches the image clipinformation, and if no, determines that the image information does notmatch the image clip information.

In addition, the server may also respectively store interactioninformation corresponding to each video information and interactioninformation corresponding to each audio information, specifically, theserver takes a screenshot of each multimedia program, obtains aplurality of video information, acquires interaction informationcorresponding to the multimedia program information, and correspondinglystores the multimedia program, the plurality of video information andthe interaction information. The server takes a screenshot of eachmultimedia program, obtains a plurality of audio information, acquiresinteraction information corresponding to the multimedia programinformation, and correspondingly stores the multimedia program, theplurality of audio information and the interaction information. Theserver takes a screenshot of video information and audio information ofthe multimedia program according to a first specified duration, andobtains a plurality of video information and a plurality of audioinformation, and durations of each video information and each audioinformation are the first specified duration.

Further, the server identifies each obtained video information, acquireskey picture, keyword, key string or key audio feature and otherinformation included in each video information, acquires interactioninformation corresponding to each video information according to the keypicture, keyword, key string or key audio feature and other informationincluded in each video information, and correspondingly stores the videoinformation, the key picture, keyword, key string or key audio featureand other information included in the video information and theinteraction information. The keyword may be text displayed in the videoinformation or broadcast text, and the key audio feature may be aneigenvalue obtained after the server performs voice recognition on audioof the video information.

In addition, the server identifies each obtained audio information,acquires keyword, key audio feature and other information included ineach audio information, acquires interaction information correspondingto each audio information according to the keyword, key audio featureand other information included in each audio information, andcorrespondingly stores the audio information, the keyword, key audiofeature and other information included in the audio information and theinteraction information. The keyword may be text broadcast in the audioinformation, and the key audio feature may be an eigenvalue obtainedafter the server performs voice recognition on the audio information.

By taking the vote information in the embodiment of the presentinvention as an example, when the server, after identifying the audioinformation, acquires the broadcast keyword “vote” and acquires songssung by a plurality of singers, it is determined that the interactioninformation is vote information including the plurality of singers.

Correspondingly, step 403 can be replaced by any one of the followingsteps 403 b to 403 d:

403 b. The server, when receiving the audio clip information, traverseseach audio information stored, determines audio information matching theaudio clip information, determines multimedia program information of thematched audio information, and acquires interaction informationcorresponding to the multimedia program information.

For each audio information stored, the server judges whether the audioinformation matches the audio clip information through voicerecognition, and determines that the audio information matches the audioclip information when the audio information is the same as the audioclip information, or determines that the audio information matches theaudio clip information when the audio information when duration of theaudio information and the same audio information in the audio clipinformation exceeds a second specified threshold. At this time, theserver acquires interaction information corresponding to the audioinformation as interaction information corresponding to the audio clipinformation, and returns the interaction information to the terminaldevice. The second specified threshold can be set by a technician duringdevelopment, which is not limited in the embodiment of the presentinvention.

Further, for each stored audio information, when the server storeskeyword, key audio feature and other information included in the audioinformation, the server identifies the audio clip information, toacquire clip keyword, clip key audio feature and other informationincluded in the audio clip information, when any one of the keyword, keyaudio feature and other information included in the audio information isthe same as any one of the clip keyword, clip key audio feature andother information included in the audio clip information, it can bedetermined that the audio information matches the audio clipinformation, or, when all the keyword, key audio feature and otherinformation included in the audio information are the same as the clipkeyword, clip key audio feature and other information included in theaudio clip information, it is determined that the audio informationmatches the audio clip information.

For example, for each audio information stored by the server, the serverobtains keywords included in the audio information previously throughvoice recognition. When receiving the audio clip information, the serveridentifies the audio clip information and obtains names of candidatesingers, and the server judges whether the keywords included in theaudio information include the names of the candidate singers, if yes,determines that the audio information matches the audio clipinformation, and if no, determines that the audio information does notmatch the audio clip information.

403 c. The server, when receiving the video clip information, traverseseach video information stored, determines video information matching thevideo clip information, determines multimedia program information of thematched video information, and acquires interaction informationcorresponding to the multimedia program information.

The video information includes image information and audio information,and the server can determine video information matching the video clipinformation in manners similar to steps 403 a and 403 b, which is notrepeated herein.

403 d. When receiving the clip information and determining that the clipinformation includes multimedia program information, the server acquiresinteraction information corresponding to the multimedia programinformation according to the multimedia program information.

During actual applications, the playback device, when playing back themultimedia program, may display the multimedia program information in alower-left corner or another region of the display screen orbroadcasting the multimedia program information in played audio, andclip information acquired by the terminal device includes the multimediaprogram information; when receiving the clip information, the serverdetermines a matched multimedia program according to the multimediaprogram information, and interaction information corresponding to themultimedia program information can be acquired.

For example, when playing back Episode 10 of the TV play “A Dream in RedMansions”, the playback device will display “A Dream in Red Mansions 10”in a lower-left corner of the display screen, image clip informationobtained by the terminal device by scanning the display screen includes“A Dream in Red Mansions 10”, and when receiving the image clipinformation, the server acquires interaction information correspondingto the multimedia program “A Dream in Red Mansions 10”.

It should be noted that, in the embodiment of the present invention, theserver acquires interaction information corresponding to the image clipinformation and sends the interaction information to the terminaldevice, and when receiving the interaction information, the terminaldevice generates an interactive interface at least including theinteraction information according to the interaction information, andoutputs the generated interactive interface. During actual applications,it is also feasible that the server previously generates an interactiveinterface at least including the interaction information according tothe interaction information, the server, when receiving the image clipinformation, can directly acquire an interactive interface correspondingto the image clip information and sends the interactive interface to theterminal device, and the terminal device, when receiving the interactiveinterface, directly outputs the interactive interface, which is notlimited in the embodiment of the present invention.

404. The server sends the interaction information to the terminaldevice.

405. The terminal device, when receiving the interaction information,outputs a vote interface at least including the multiple candidateoptions.

The interaction information may be vote information including themultiple candidate options, or may be a webpage link address used fordetermining vote information including the multiple candidate options,and the terminal device, when receiving the webpage link address, jumpsto the webpage link address, and displays a vote interface at leastincluding the multiple candidate options.

During actual applications, the server can initiate a vote activity, toguide users to vote. When the image clip information acquired by theterminal device includes vote-related content, the interactioninformation acquired by the server may be vote information includingmultiple candidate options, the terminal device outputs a vote interfaceat least including the multiple candidate options when receiving theinteraction information, and the users can select a candidate option onthe vote interface according to personal opinions, to vote for theselected candidate option.

In addition, the vote interface may further include data of eachcandidate option, name of the vote activity, organizer of the voteactivity and other information, which is not limited in the embodimentof the present invention. The vote interface may be an H5 Hyper TextMarkup language 5) page or another form of pages, which is not limitedin the embodiment of the present invention.

It should be noted that, the embodiment of the present invention takesthat the interaction information is vote information including multiplecandidate options as an example, the terminal device outputs the voteinterface, however, actually, the interaction information may also beinformation in other interactive forms, for example, interactive quizinformation, answer information and the like, and the terminal device,when receiving the interaction information, outputs an interactiveinterface in a corresponding interactive form according to theinteraction information. If the interaction information includesinformation in two or more interactive forms, the terminal device mayoutput one interactive interface therein, or output a formal selectioninterface, a user selects a desired interactive form in the formalselection interface, and the terminal device outputs a correspondinginteractive interface according to the interactive form selected by theuser.

406. The terminal device, when detecting a user's selection operation ona specified candidate option in the vote interface, sends the specifiedcandidate option to the server.

The embodiment of the present invention takes a specified candidateoption in the multiple candidate options as an example, the terminaldevice, when detecting a user's selection operation on the specifiedcandidate option, sends the specified candidate option to the server,and the server, when receiving the specified candidate option, increasesthe number of votes for the specified candidate option.

Referring to FIG. 4E, the vote interface includes two candidate option,i.e., “Player 1” and “Player 2”, and an “OK” key, when the terminaldevice detects a click operation on the “OK” key after a user selects“Player 2”, it indicates that the user votes for the “Player 2”, andwhen the terminal device sends the option of “Player 2” to the server,the server increases 1 to the number of votes for “Player 2” whenreceiving the option of “Player 2” sent by the terminal device.

407. The server increases the number of votes for the specifiedcandidate option when receiving the specified candidate option.

When the server receives the specified candidate option, it indicatesthat the user of the terminal device votes for the specified candidateoption, and the server increases 1 to the number of votes for thespecified candidate option.

Further, the server can determine a voting weight of each user IDaccording to levels of user IDs of each terminal device, the server,when receiving the specified candidate option sent by the terminaldevice based on an user ID, determines a voting weight of the user ID,and increases the number of votes for the specified candidate optionaccording to the voting weight. For example, if the voting weight of theuser ID is 2, the server increases 2 to the number of votes for thespecified candidate option.

The embodiment of the present invention only takes one vote activity asan example, the server can determine that the user of the terminaldevice votes for the specified candidate option, however, during actualapplications, the server may be carrying out a plurality of voteactivities, each vote activity includes multiple candidate options, anddifferent vote activities may include the same candidate options. Atthis time, the server may assign one vote ID and one database for eachvote activity, one vote ID corresponds to multiple candidate options,the database is configured to count the number of votes for the multiplecandidate options, the vote information including the multiple candidateoptions determined by the server according to the clip informationfurther includes the vote ID, the terminal device can obtain the vote IDwhen receiving the interaction information, then the terminal device cansend the vote ID to the server while sending the specified candidateoption to the server, and the server, when receiving the vote ID, canfirst determine a vote activity in which the terminal deviceparticipates, and increase the number of votes for the specifiedcandidate option in the vote activity in the database corresponding tothe vote activity. The vote ID may be name of the vote activity ornumber of the vote activity or the like, which is not limited in theembodiment of the present invention.

For example, two vote activities that the server is carrying out are asshown in Table 1 below.

TABLE 1 Vote ID Candidate option Favorite Male Artist Liu Dehua ZhangXueyou Chen Yixun Favorite Actor Liu Dehua Liang Chaowei Zhang Jiahui

The server, when receiving clip information sent by the terminal device,determines that interaction information corresponding to the clipinformation is vote information including three candidate options, i.e.,“Liu Dehua”, “Zhang Xueyou” and “Chen Yixun”, and the vote ID of“Favorite Male Artist”, sends the vote information to the terminaldevice, the server, when receiving the option of “Liu Dehua” and thevote ID of “Favorite Male Artist” sent by the terminal device,determines that the terminal device votes for the option of “Liu Dehua”in the vote activity of “Favorite Male Artist”, and the server increasesthe number of votes for the option of “Liu Dehua” in the databasecorresponding to the vote activity of “Favorite Male Artist”. In thevote process, the server will not increase the number of votes for theoption of “Liu Dehua” in the vote activity of “Favorite Actor”.

408. The server sends the number of votes for each candidate optioncurrently counted to the terminal device.

In the embodiment of the present invention, the server counts the numberof votes for each candidate option according to candidate options sentby each terminal device participating in voting, and the server, whenreceiving a specified candidate option sent by the terminal device, cansend the number of votes for each candidate option currently counted tothe terminal device, so that the terminal device displays the number ofvotes for each candidate option, to enable users to know a currentvoting result.

The terminal device, when sending the specified candidate option to theserver, displays a voting result display option, the terminal device,when detecting a user's click operation on the voting result displayoption, sends a voting result request to the server, and the server,when receiving the voting result request, sends the number of votes foreach candidate option currently counted to the terminal device.

Further, the server, when receiving a voting result request of oneterminal device, judges whether the terminal device has the right todisplay a voting result, and, when determining that the terminal devicehas the right to display a voting result, sends the number of votes foreach candidate option currently counted to the terminal device. Theserver can judge whether the terminal device has sent any candidateoption when judging whether the terminal device has the right to displaya voting result, that is, whether the terminal device has voted isjudged. The server determines that the terminal device has the right todisplay a voting result when determining that the terminal device hassent any candidate option, while the server determines that the terminaldevice does not have the right to display a voting result whendetermining that the terminal device has not sent any candidate option.The server guides users who hope to see the voting result to vote bylimiting the right to display the voting result.

It should be noted that, steps 408-409 are optional steps, the servermay not perform step 408, perform step 408 after step 407, or performstep 408 when receiving the voting result request of the terminal deviceand determining that the terminal device has the right to display avoting result, and the embodiment of the present invention does notlimit whether the server performs step 408 and the time when step 408 isperformed.

409. The terminal device, when receiving the number of votes for eachcandidate option, displays the number of votes for each candidateoption.

The terminal device generates a voting result display interface at leastincluding the number of votes for each candidate option according to thenumber of votes for each candidate option, and outputs the voting resultdisplay interface, so that the user can see the number of votes for eachcandidate option.

Further, in the voting result display interface, the terminal device candisplay the number of votes for each candidate option in a digital form,or display the number of votes for each candidate option in a pie chartform, or display the number of votes for each candidate option in ahistogram form. In addition, when displaying the number of votes foreach candidate option, the terminal device can highlight the number ofvotes for the specified candidate option, and the embodiment of thepresent invention does not limit the display manner of the terminaldevice.

It should be noted that, the embodiment of the present invention is onlydescribed by taking an interaction process between the terminal deviceand the server as an example, and actually, the interaction process canbe carried out by a plurality of servers in a server cluster and theterminal device. By taking that the terminal device votes through the IMapplication as an example, the server cluster includes a playbackserver, an IM server, an interaction information storage server and avote server, the playback server and the playback device communicatewith each other through a network connection, the playback server isconfigured to provide a multimedia program for the playback device, andthe terminal device and the IM server communicate with each otherthrough a network connection. The terminal device, when acquiring theimage clip information, sends the image clip information to the IMserver, the IM server, when receiving the image clip information,forwards the image clip information to the interaction informationstorage server, the interaction information storage server, whenreceiving the image clip information, acquires interaction informationcorresponding to the image clip information, that is, vote informationincluding multiple candidate options, and returns the interactioninformation to the IM server, and the IM server, when receiving theinteraction information, forwards the interaction information to theterminal device. In a subsequent process, the IM server, when receivinga specified candidate option sent by the terminal device, forwards thespecified candidate option to the vote server, and the vote server, whenreceiving the specified candidate option, increases the number of votesfor the specified candidate option. The embodiment of the presentinvention does not limit the plurality of servers in the server cluster.

The method in the embodiment of the present invention takes that theinteraction information is vote information including multiple candidateoptions as an example, the playback device can guide users toparticipate in voting each time the playback device plays back themultimedia program, thereby prolonging effective time of the voting, andthe users can participate in the voting only by selecting a candidateoption on the vote interface, which is easy to operate, improvesinteraction efficiency, increases the number of users participating ininteraction, and enhances user viscosity.

FIG. 5A is a flowchart of an interaction method based on multimediaprograms according to one embodiment of the present invention.Interaction bodies in the embodiment of the present invention are aterminal device and a server; for ease of description, the embodiment ofthe present invention takes that the image clip information includesinteractive quiz-related content as an example, and interactioninformation corresponding to the image clip information is interactivequiz information including multiple candidate options; referring to FIG.5A, the method includes:

501. A terminal device acquires image clip information of a multimediaprogram in a process of playing back the multimedia program.

502. The terminal device sends the image clip information to the server.

Steps 501-502 are similar to steps 401-402, and are not repeated herein.

503. The server, when receiving the image clip information, determinesmultimedia program information matching the image clip informationaccording to the image clip information, and acquires interactioninformation corresponding to the multimedia program information, theinteraction information being interactive quiz information includingmultiple candidate options.

During actual applications, the server can acquire video streaming of anongoing game from a TV station and send the video streaming to theplayback device, the playback device plays back the video streaming whenreceiving the video streaming, and the terminal device can play back thegame in a form of live Internet broadcasts. During playback, userscannot know a game result, the server can set an interactive quizactivity for the game, to guide the users to interactive quiz the gameresult, the clip information includes content related to game resultinteractive quiz, and interaction information corresponding to the gameis interactive quiz information.

The image clip information may include a keyword “interactive quiz” andnames, numbers or flag pictures or the like of both game players, forexample, the server, when identifying the image clip information andacquiring the keyword “interactive quiz” and the names of two players,determines that interaction information corresponding to the image clipinformation is interactive quiz information including the names of thetwo players. In addition, when the terminal device acquires audio clipinformation, the audio clip information may include broadcast“interactive quiz” and names or numbers of both game players or thelike. For example, the server, when identifying the audio clipinformation and acquiring the keyword “interactive quiz” and the namesof two players, determines that interaction information corresponding tothe audio clip information is interactive quiz information including thenames of the two players.

504. The server sends the interaction information to the terminaldevice.

505. The terminal device, when receiving the interaction information,outputs an interactive quiz interface at least including the multiplecandidate options.

The interaction information acquired by the server may be interactivequiz information including multiple candidate options, the terminaldevice, when receiving the interaction information, outputs aninteractive quiz interface at least including the multiple candidateoptions, and the users can select a predicted candidate option in theinteractive quiz interface. In addition, the interactive quiz interfacemay further include data of each candidate option, the amount of virtualreward data issued in the event of correct interactive quiz and otherinformation, which is not limited in the embodiment of the presentinvention.

506. The terminal device, when detecting a user's selection operation ona specified candidate option in the interactive quiz interface, sendsthe specified candidate option to the server.

The embodiment of the present invention takes a specified candidateoption in the multiple candidate options as an example, the terminaldevice, when detecting a user's selection operation on the specifiedcandidate option, sends the specified candidate option to the server,and the server, when receiving the specified candidate option, judgeswhether the specified candidate option is correct after waiting fordetermining the interactive quiz result.

Referring to FIG. 5B, the interactive quiz interface includes twocandidate options, i.e., “Player 1” and “Player 2”, and an “OK” key,when the terminal device detects a click operation on the “OK” key aftera user selects “Player 2”, it indicates that the user predicts that“Player 2” will win, the terminal device sends the option of “Player 2”to the server, and the server receives the option of “Player 2” sent bythe terminal device.

507. The server, when receiving the specified candidate option, judgeswhether the specified candidate option is correct.

When the server receives the specified candidate option, if a gameresult has not yet been generated, the server records the specifiedcandidate option, waits for generation of the game result, and judgeswhether the specified candidate option is correct when the game resultis generated.

During actual applications, the server records candidate options sent byeach terminal device, waits for generation of a game result, and judgeswhether the candidate options sent by each terminal device are correctwhen the game result is generated.

It should be noted that, the embodiment of the present invention takesone interactive quiz activity as an example, the server, when receivingthe specified candidate option, determines that the user of the terminaldevice predicts that the specified candidate option will win, however,during actual application, the server may be carrying out a plurality ofinteractive quiz activities, each interactive quiz activity includesmultiple candidate options, and different interactive quiz activitiesmay include the same candidate options. At this time, the server mayassign one interactive quiz ID and one database for each interactivequiz activity, one interactive quiz ID corresponds to multiple candidateoptions, the database is configured to count the number of terminaldevices sending the multiple candidate options, interactive quizinformation including the multiple candidate options determined by theserver according to the clip information further includes theinteractive quiz ID, the terminal device can obtain the interactive quizID when receiving the interaction information, then the terminal devicecan send the interactive quiz ID to the server while sending thespecified candidate option to the server, and the server, when receivingthe interactive quiz ID, can first determine an interactive quizactivity in which the terminal device participates, and then judgeswhether the specified candidate option is correct. The interactive quizID may be name of the interactive quiz activity or number of theinteractive quiz activity or the like, which is not limited in theembodiment of the present invention.

For example, two interactive quiz activities that the server is carryingout are “Predict champion of the World Cup for the first team” and“Predict World Cup championship”, the server, when receiving an optionof “Team Great Britain” and “Predict champion of the World Cup for thefirst team” sent by the terminal device, records the option of “TeamGreat Britain” guessed by the terminal device in a databasecorresponding to the interactive quiz activity “Predict champion of theWorld Cup for the first team”, when waiting for generation of a gameresult of the World Cup for the first team, judges according to the gameresult whether “Team Great Britain” predicted by the terminal device isthe champion of the World Cup for the first team, if yes, determinesthat the terminal device guesses correctly, and if no, determines thatthe terminal device guesses incorrectly.

508. The server sends virtual reward data to the terminal deviceaccording to a judgment result.

When the specified candidate option is correct, the server sends aninteractive quiz correct message to the terminal device, and at thistime, the server can send a certain amount of virtual reward data to theterminal device. When the specified candidate option is incorrect, theserver sends an interactive quiz incorrect message to the terminaldevice, and at this time, the server cannot send virtual reward data tothe terminal device or sends a less amount of virtual reward data to theterminal device. The amount of the virtual reward data is pre-determinedby the server, or determined by the server according to levels of userIDs of the terminal device, which is not limited in the embodiment ofthe present invention.

Based on the example in step 505, when “Player 1” wins, the server sendsan interactive quiz incorrect message to the terminal device, and when“Player 2” wins, the server sends an interactive quiz correct messageand a certain amount of virtual reward data to the terminal device.

509. The terminal device, when receiving the virtual reward data,displays the virtual reward data.

The method in the embodiment of the present invention takes that theinteraction information is interactive quiz information includingmultiple candidate options as an example, the playback device can guideusers to participate in interactive quiz each time the playback deviceplays back the multimedia program, thereby prolonging effective time ofthe interactive quiz, and the users can participate in the interactivequiz only by selecting a candidate option on the interactive quizinterface, which is easy to operate, improves interaction efficiency,increases the number of users participating in interaction, and enhancesuser viscosity.

FIG. 6A is a flowchart of an interaction method based on multimediaprograms according to one embodiment of the present invention.Interaction bodies in the embodiment of the present invention are aterminal device and a server; for ease of description, the embodiment ofthe present invention takes that the image clip information includesanswer-related content as an example, and interaction informationcorresponding to the image clip information is answer informationincluding a question; referring to FIG. 6A, the method includes:

601. A terminal device acquires image clip information of a multimediaprogram in a process of playing back the multimedia program.

602. The terminal device sends the image clip information to the server.

Steps 601-602 are similar to steps 401-402, and are not repeated herein.

603. The server, when receiving the image clip information, determinesmultimedia program information matching the image clip informationaccording to the image clip information, and acquires interactioninformation corresponding to the multimedia program information, theinteraction information being answer information including a question.

When the image clip information includes answer-related content,interaction information corresponding to the image clip information isanswer information including a question. The image clip information mayinclude keywords such as “ask a question”, “excuse me” or “pleaseanswer” and corresponding questions, for example, the image clipinformation includes “please answer the name of the Chinese film thatwon an Oscar for the best foreign language film”, the server identifiesthe image clip information, to acquire the keyword “please answer”, anddetermines that the question is “the name of the Chinese film that wonan Oscar for the best foreign language film”, and the interactioninformation is answer information including the question “the name ofthe Chinese film that won an Oscar for the best foreign language film”.

604. The server sends the interaction information to the terminaldevice.

605. The terminal device, when receiving the interaction information,outputs an answer interface at least including an answer input field,and acquires an answer input into the answer input field by the user.

The interaction information acquired by the server is answer informationincluding a question, the terminal device, when receiving theinteraction information, outputs an answer interface at least includingan answer input field, the user can input an answer to the question intothe answer input field of the answer interface, and the terminal deviceacquires the answer.

During actual application, the terminal device, when playing back theimage clip information, will play back a question to be answered, theuser can obtain the question, and the answer interface output by theterminal device may include the question or may not include thequestion, which is not limited in the embodiment of the presentinvention. Certainly, the answer interface may further include theamount of virtual reward data issued when the answer is correct andother information, which is not limited in the embodiment of the presentinvention.

Referring to FIG. 6B, the answer interface includes a question “pleaseanswer the name of the Chinese film that won an Oscar for the bestforeign language film” and an answer input field, the terminal device,when acquiring an answer input into the answer input field by the user,sends the answer to the server, and the server receives the answer.

It should be noted that, the embodiment of the present invention takesthat the user inputs an answer in the answer input field as an example,actually, when the answer is a choice question, the interactioninformation is answer information including multiple candidate options,at this time, the terminal device outputs an answer interface at leastincluding the multiple candidate options, and the user can select onecandidate option in the answer interface as the user's answer. Theexecution process when the interaction information is answer informationincluding multiple candidate options is similar to the execution processwhen the interaction information is interactive quiz informationincluding multiple candidate options, which is not repeated herein.

Referring to FIG. 6C, the answer interface includes two candidateoptions, i.e., “Answer 1” and “Answer 2”, and an “OK” key, the terminaldevice, when detecting a click operation on the “OK” key after a userselects “Answer 2”, sends the option of “Answer 2” to the server, andthe server receives the option of “Answer 2”.

606. The terminal device sends the answer to the server.

607. The server, when receiving the answer, judges whether the answer iscorrect.

608. The server sends virtual reward data to the terminal deviceaccording to a judgment result.

609. The terminal device, when receiving the virtual reward data,displays the virtual reward data.

Steps 606-609 are similar to steps 506-509, and are not repeated herein.

The method in the embodiment of the present invention takes that theinteraction information is answer information including a question as anexample, the playback device can guide users to participate in answeringa question each time the playback device plays back the multimediaprogram, thereby prolonging effective time of answering the question,and the users can participate in answering the question only byselecting a candidate option on the answer interface, which is easy tooperate, improves interaction efficiency, increases the number of usersparticipating in interaction, and enhances user viscosity.

FIG. 7A is a flowchart of an interaction method based on multimediaprograms according to one embodiment of the present invention.Interaction bodies in the embodiment of the present invention are aterminal device and a server; for ease of description, the embodiment ofthe present invention takes that the image clip information includeslottery-related content as an example, and interaction informationcorresponding to the image clip information is lottery information;referring to FIG. 7A, the method includes:

701. A terminal device acquires image clip information of a multimediaprogram in a process of playing back the multimedia program.

702. The terminal device sends the image clip information to the server.

Steps 701-702 are similar to steps 401-402, and are not repeated herein.

703. The server, when receiving the image clip information, determinesmultimedia program information matching the image clip informationaccording to the image clip information, and acquires interactioninformation corresponding to the multimedia program information, theinteraction information being lottery information.

When the image clip information includes lottery-related content,interaction information corresponding to the image clip information islottery information. The lottery information may be name of a lotteryactivity organizer, introduction to the virtual reward data and thelike, which is not limited to the embodiment of the present invention.The image clip information may include a keyword “lottery” and the nameof a lottery activity, and the server, when identifying the image clipinformation and acquiring the keyword “lottery” and the name of thelottery activity, determines that the interaction information is lotteryinformation corresponding to the name.

704. The server sends the interaction information to the terminaldevice, and step 706 is performed.

705. The terminal device, when receiving the interaction information,outputs a lottery interface at least including the lottery information.

The interaction information acquired by the server is lotteryinformation, and the terminal device, when receiving the interactioninformation, outputs a lottery interface at least including the lotteryinformation, to prompt a user that the server is drawing a lottery. Thelottery interface may include a lottery waiting message or otherinformation, which is not limited in the embodiment of the presentinvention.

706. The server draws a lottery randomly, to obtain a lottery result.

The server pre-determines a plurality of virtual reward data, randomlyassigns one virtual reward data to the terminal device, and takes theassigned virtual reward data as a lottery result of the terminal deviceto be returned to the terminal device. The server may also encapsulatethe plurality of virtual reward data into a form of a lottery card, andsends the encapsulated virtual reward data to the terminal device, theterminal device displays the plurality of lottery cards, the terminaldevice, when detecting a user's click operation on a specified lotterycard, sends the specified lottery card to the server, and the server,when receiving the specified lottery card, determines virtual rewarddata in the specified lottery card, and takes the virtual reward data asa lottery result of the terminal device.

Referring to FIG. 7B, the lottery interface includes two lottery cardoptions, i.e., “Lottery card 1” and “Lottery card 2”, and an “OK” key,the terminal device, when detecting a click operation on the “OK” keyafter a user selects “Lottery card 2”, sends the option of “Lottery card2” to the server, and the server receives the option of “Lottery card2”, and takes virtual reward data in the Lottery card 2 as a lotteryresult of the terminal device.

In addition, the lottery interface may further include the amount ofvirtual reward data corresponding to each lottery option or otherinformation, which is not limited in the embodiment of the presentinvention.

It should be noted that, the embodiment of the present invention takesthat step 706 is performed after step 704 as an example, actually, step706 may be performed simultaneously with step 704, or step 706 isperformed after step 704 has been performed after a second specifiedduration, and the second specified duration may be determined by theserver according to a current network condition, which is not limited inthe embodiment of the present invention.

707. The server sends the lottery result to the terminal device.

708. The terminal device, when receiving the lottery result, displaysthe lottery result in the lottery interface.

The method in the embodiment of the present invention takes that theinteraction information is answer information including a question as anexample, the playback device can guide users to participate in answeringa question each time the playback device plays back the multimediaprogram, thereby prolonging effective time of answering the question,and the users can participate in answering the question only byselecting a candidate option on the answer interface, which is easy tooperate, improves interaction efficiency, increases the number of usersparticipating in interaction, and enhances user viscosity.

FIG. 8A is a flowchart of an interaction method based on multimediaprograms according to one embodiment of the present invention.Interaction bodies in the embodiment of the present invention are aterminal device and a server; for ease of description, the embodiment ofthe present invention takes that interaction information correspondingto the image clip information is comment information including contentto be commented; referring to FIG. 8A, the method includes:

801. A terminal device acquires image clip information of a multimediaprogram in a process of playing back the multimedia program.

802. The terminal device sends the image clip information to the server.

Steps 801-802 are similar to steps 401-402, and are not repeated herein.

803. The server, when receiving the image clip information, determinesmultimedia program information matching the image clip informationaccording to the image clip information, and acquires interactioninformation corresponding to the multimedia program information, theinteraction information being comment information including content tobe commented.

The content to be commented may be the multimedia program, charactersappearing in the image clip information, lines appearing in the imageclip information and the like, and the content to be commented may bedetermined by the server according to the image clip information, whichis not limited in the embodiment of the present invention. The imageclip information may include a keyword “leave a message” or “comment”and corresponding content to be commented. For example, the image clipinformation includes “welcome to leave a message at Happy Camp'sofficial Weibo”, and the server identifies the image clip information,acquires the keyword “leave a message” and the corresponding content tobe commented “Happy Camp”, and determines that the interactioninformation is comment information including the content to be commented“Happy Camp”.

804. The server sends the interaction information to the terminaldevice.

805. The terminal device, when receiving the interaction information,outputs a comment interface at least including the content to becommented and a comment input field, and acquires a comment input intothe comment input field by a user.

The terminal device, when receiving the interaction information, outputsa comment interface at least including the content to be commented and acomment input field, and a user can browse the content to be commentedin the comment interface, and inputs a comment upon the content to becommented in the comment input field. The comment interface may furtherinclude a release option, and the terminal device, after detecting aclick operation on the release option after the user inputs a comment inthe comment input field, acquires the comment and sends the comment tothe server.

In addition, the interaction information may further include otherusers' comments of the content to be commented, the comment interfacemay include other users' comments of the content to be commented, apraise option corresponding to the comment and a reply option, theterminal device, when detecting a user's click operation on any replyoption, displays a reply input field, and the user can input a reply tothe comment corresponding to the reply option in the reply input field.When the terminal device detects the user's downward sliding operationin the process of displaying the comment interface, the commentinterface can be refreshed.

806. The terminal device sends the comment to the server.

807. The server, when receiving the comment, releases the comment in acomment display region of the content to be commented.

The comment display region is used for displaying a user's comment uponthe content to be commented, and can be located below or on the right ofthe content to be commented. The server, when receiving the comment,releases the comment as the terminal device in the comment displayregion, so that other users can browse or make a reply to the commentupon the user of the terminal device. The server, when receiving thecomment, examines the comment, and after the examination is passed,releases the comment as the terminal device in the comment displayregion.

Referring to FIG. 8B, the comment interface includes content to becommented “Happy Camp”, a comment display region, a comment input fieldand a “release” option, the comment display region includes commentsreleased by “User 1” and “User 2” and a “praise” option and a “reply”option corresponding to each comment, a user can click the “praise”option to praise the corresponding comment, or click the “reply” optionto make a reply to the corresponding comment. The user can input acomment upon “Happy Camp” in the comment input field, and the terminaldevice, when detecting the user's click operation on the “release”option, acquires a comment in the comment input field, and sends thecomment to the server, so that the server releases the comment in thecomment display region.

The method in the embodiment of the present invention takes that theinteraction information is comment information including content to becommented as an example, the playback device can guide users toparticipate in comments each time the playback device plays back themultimedia program, thereby prolonging effective time of the comments,and the users only need to input comments in the comment interface,which is easy to operate, improves interaction efficiency, increases thenumber of users participating in interaction, and enhances userviscosity.

FIG. 9A is a flowchart of an interaction method based on multimediaprograms according to one embodiment of the present invention.Interaction bodies in the embodiment of the present invention are aterminal device and a server; for ease of description, the embodiment ofthe present invention takes that the image clip information includesexchange target-related content as an example, and interactioninformation corresponding to the image clip information is targetinformation including a target value; referring to FIG. 9A, the methodincludes:

901. A terminal device acquires image clip information of a multimediaprogram in a process of playing back the multimedia program.

902. The terminal device sends the image clip information to the server.

Steps 901-902 are similar to steps 401-402, and are not repeated herein.

903. The server, when receiving the image clip information, determinesmultimedia program information matching the image clip informationaccording to the image clip information, and acquires interactioninformation corresponding to the multimedia program information, theinteraction information being target information including a targetvalue.

When the image clip information includes exchange target-relatedcontent, interaction information corresponding to the image clipinformation is target information including a target value. The imageclip information may include a keyword “buy” and name and value of acorresponding target, for example, the image clip information includes“leather skinny windbreaker, only 159 Yuan, welcome to buy”, the server,after identifying the image clip information, acquires the keyword “buy”and the corresponding target name “leather skinny windbreaker” and thevalue “159 Yuan”, and determines that the interaction informationcorresponding to the image clip information is target informationincluding the target value “159 Yuan”.

904. The server sends the interaction information to the terminaldevice.

905. The terminal device, when receiving the interaction information,outputs a target display interface at least including the targetinformation and an exchange option, and the terminal device, whendetecting a user's click operation on the exchange option, outputs avalue transfer interface at least including the target value and a valuetransfer option.

The interaction information acquired by the server is target informationincluding a target value, and the terminal device, when receiving theinteraction information, outputs a target display interface at leastincluding the target information and an exchange option. The targetinformation may also include the target's picture, name, special offersand the like, and a user can browse the target information in the targetdisplay interface.

When the user hopes to exchange the target for the target value, theuser clicks the exchange option, and the terminal device, when detectingthe user's click operation on the exchange option, outputs a valuetransfer interface at least including the target value and a valuetransfer option. Specifically, the terminal device, when detecting theuser's click operation on the exchange option, sends an order requestfor the target to the server, and the server, when receiving the orderrequest, generates an order of the target, the order including thetarget value, order number and other information. The server sends theorder to the terminal device, and the terminal device, when receivingthe order, outputs the value transfer interface at least including thetarget value and the value transfer option. Afterwards, the terminaldevice, when detecting the user's click operation on the value transferoption, sends a value transfer request for the target to the server.

Referring to FIG. 9B, the target display interface includes the target'spicture “Picture 1”, name “leather skinny windbreaker, value “159 Yuan”,special offer “30% discount” and exchange option “buy”, and the terminaldevice, when detecting the user's click operation on the option of“buy”, displays a value transfer interface as shown in FIG. 9C. thevalue transfer interface includes an order number “51681623”, the value“159 Yuan” and a value transfer option “payment”, and the terminaldevice, when detecting the user's click operation on the option of“payment”, sends a value transfer request for the target to the server,so that the server, when receiving the value transfer request, performsa value transfer operation.

It should be noted that, when the interaction information is targetinformation including a target value, the terminal device first outputsthe target display interface, and then outputs the value transferinterface when detecting the user's click operation on the exchangeoption, while, in another embodiment provided in the embodiment of thepresent invention, when the interaction information is value transferinformation including the target value, the terminal device can directlyoutput the value transfer interface, that is, the server, when receivingthe image clip information, acquires the interaction information anddirectly generates an order according to the interaction information,which does not require the user to click the exchange option, simplifiesthe user's operation, and saves the time consumed by value transfer.

906. The terminal device, when detecting the user's click operation onthe value transfer option, sends a value transfer request for the targetto the server.

907. The server, when receiving the value transfer request for thetarget from the terminal device, performs a value transfer optionaccording to the value, account information corresponding to the targetand account information corresponding to the terminal device.

The server, when receiving the value transfer request for the targetfrom the terminal device, acquires the value, account informationcorresponding to the target and account information corresponding to theterminal device, and transfers the value from the account informationcorresponding to the terminal device to the account informationcorresponding to the target, that is, the server decreases the value ofthe account information corresponding to the terminal device by thevalue and increases the value of the account information correspondingto the target by the value, to complete the value transfer operation onthe target. The account information corresponding to the target can bepre-loaded by an owner of the target to the server, and the accountinformation corresponding to the terminal device can be pre-bound by theterminal device, or sent to the server while the value transfer requestis sent to the server, which is not limited in the embodiment of thepresent invention.

The method in the embodiment of the present invention takes that theinteraction information is target information including a target valueas an example, the playback device can guide users to browse the targetinformation each time the playback device plays back the multimediaprogram, thereby prolonging effective time, the users can exchange thetarget for the target value only by clicking the exchange option on thetarget display interface, which is easy to operate, improves interactionefficiency, does not need to interrupt the process that the users watchthe multimedia program, increases the number of users participating ininteraction, and enhances user viscosity.

FIG. 10A is a flowchart of an interaction method based on multimediaprograms according to one embodiment of the present invention.Interaction bodies in the embodiment of the present invention are aterminal device and a server; for ease of description, the embodiment ofthe present invention takes that the image clip information includescharacter-related content as an example, and interaction informationcorresponding to the image clip information is a first user ID of thecharacter; referring to FIG. 10A, the method includes:

1001. A terminal device acquires image clip information of a multimediaprogram in a process of playing back the multimedia program.

1002. The terminal device sends the image clip information to theserver.

Steps 1001-1002 are similar to steps 401-402, and are not repeatedherein.

1003. The server, when receiving the image clip information, determinesmultimedia program information matching the image clip informationaccording to the image clip information, and acquires interactioninformation corresponding to the multimedia program information, theinteraction information being a first user ID and an instruction ofcalling an IM session window.

When the image clip information includes content related to a character,the interaction information is a first user ID of the character, and thefirst user ID may be a private user ID or public user ID of thecharacter. The image clip information may include a human face picture,the server identifies the image clip information, determines a characterof the human face picture, and determines that the interactioninformation is a first user ID of the character. For example, the serveridentifies the image clip information, determines that the image clipinformation include Lin Zhiling's human face picture, and determinesthat the interaction information is Lin Zhiling's public account. Whenthe terminal device acquires audio clip information, the audio clipinformation may include a broadcast character name, and the serveridentifies the audio clip information, acquires the character name, anddetermines that the interaction information is a first user ID of thecharacter. For example, the audio clip information includes “Welcome LinZhiling to be a guest of the talk show”, and the server identifies theaudio clip information, determines that the audio clip informationincludes a character name “Lin Zhiling”, and determines that theinteraction information is Lin Zhiling's public account.

1004. The server sends the interaction information to the terminaldevice.

1005. The terminal device, when receiving the interaction information,judges whether a user relation chain of a second user ID used by theterminal device includes the first user ID.

In the embodiment of the present invention, the terminal device logs onto the server based on the second user ID, to exchange information withthe server. The server can maintain a user relation chain of each userID, and the user relation chain of the second user ID includes at leastone user ID concerned by the second user ID.

The terminal device, when receiving the first user ID and theinstruction of call an IM session window, judges whether a user relationchain of a second user ID used by the terminal device includes the firstuser ID. When the user relation chain includes the first user ID, itindicates that the second user ID has paid attention to the first userID, and the terminal device, in response to the instruction, calls an IMsession window of the second user ID and the first user ID, and displaysa session interface at least including the IM session window. When theuser relation chain does not include the first user ID, it indicatesthat the second user ID has not paid attention to the first user ID, andthe terminal device displays a details interface at least includingdetails information and an attention option of the first user ID, sothat the user can browse the details information of the first user IDand determine whether to attention on the first user ID according to thedetails information.

It should be noted that, the judgment process may be performed by theserver, that is, the server, when acquiring the first user ID, acquiresa second user ID used by the terminal device, and judges whether a userrelation chain of the second user ID includes the first user ID, if yes,the server sends the first user ID and the instruction of calling an IMsession window to the terminal device, and if no, the server sends thefirst user ID to the terminal device.

1006. When the user relation chain of the second user ID includes thefirst user ID, the terminal device outputs a session interface at leastincluding an IM session window of the second user ID and the first userID, and acquires an IM message input into the IM session window by theuser.

Referring to FIG. 10B, the IM session window in the session interfaceincludes the first user ID “Lin Zhiling”, a head portrait “Head portrait1” of the first user ID, a head portrait “Head portrait 2” of the seconduser ID, an IM message input field and a “Send” key, and the terminaldevice, when detecting the user's click operation on the “Send” key,acquires an IM message “hello” input into the IM message input field bythe user, and sends the IM message “hello” to the server based on thesecond user ID, so that the server, when receiving the IM message, sendsthe IM message to a terminal device where the first user ID “LinZhiling” is.

1007. The terminal device sends the IM message to the server based onthe second user ID.

1008. The server, when receiving the IM message, sends the IM message toa terminal device where the first user ID is.

In another embodiment provided in the embodiment of the presentinvention, steps 1006-1008 can be replaced with the following step: whenthe user relation chain of the second user ID does not include the firstuser ID, outputting, by the terminal device, a details interface atleast including details information and an attention option of the firstuser ID. The terminal device, when detecting the user's click operationon the attention option in the details interface, sends an attentionrequest for the first user ID to the server based on the second user ID,and the server, when receiving the attention request, adds the firstuser ID to the user relation chain of the second user ID.

Referring to FIG. 10C, the details interface include the first user ID“Lin Zhiling”, a head portrait “Head portrait 1” of the first user ID,an account “linzhiling”, personalized signature “Give a person a smileevery day”, authentication information “Lin Zhiling: famous artist,actress, model, singer in Asia” and an “attention” key. The server, whendetecting the user's click operation on the “attention” key, sends anattention request for the first user ID “Lin Zhiling” to the serverbased on the second user ID, the server, when receiving the attentionrequest, adds the first user ID “Lin Zhiling” to the user relation chainof the second user ID, and the terminal device can receive an IM messagesent by the first user ID “Lin Zhiling”, or sends an IM message to aterminal device where the first user ID “Lin Zhiling” is.

The method in the embodiment of the present invention takes that theinteraction information is a first user ID as an example, the playbackdevice can guide users to transfer the IM message to the first user IDor pay attention to the first user ID each time the playback deviceplays back the multimedia program, thereby prolonging effective time,which is easy to operate, improves interaction efficiency, increases thenumber of users participating in interaction, and enhances userviscosity.

FIG. 11A is a flowchart of an interaction method based on multimediaprograms according to one embodiment of the present invention.Interaction bodies in the embodiment of the present invention are aterminal device and a server; for ease of description, the embodiment ofthe present invention takes that interaction information correspondingto the image clip information is multimedia program information as anexample; referring to FIG. 11A, the method includes:

1101. A terminal device acquires image clip information of a multimediaprogram in a process of playing back the multimedia program.

1102. The terminal device sends the image clip information to theserver.

Steps 1101-1102 are similar to steps 401-402, and are not repeatedherein.

1103. The server, when receiving the image clip information, determinesmultimedia program information matching the image clip informationaccording to the image clip information, and acquires interactioninformation corresponding to the multimedia program information, theinteraction information being multimedia program information.

When the server identifies the image clip information but does notacquire keywords, key pictures and other information, it can bedetermined that interaction information corresponding to the image clipinformation is multimedia program information of the multimedia program.

In terms of content of the multimedia program information, themultimedia program information may include a link address of themultimedia program, user IDs where the multimedia program has beenplayed, recommended multimedia programs and the like, and in terms offormat of the multimedia program information, the multimedia programinformation may include pictures, text, graphics and text information,video and the like, which is not limited in the embodiment of thepresent invention.

It should be noted that, when the multimedia program informationincludes the link address of the multimedia program, the terminaldevice, when acquiring multimedia program information returned by theserver, can jump to the link address of the multimedia program, to playback the multimedia program. When the terminal device is a deviceindependent of the playback device, in the process that the playbackdevice plays back the multimedia program, the user can watch themultimedia program on the terminal device only by scanning the displayscreen with the terminal device to or shaking the terminal device,thereby achieving projection of the multimedia program from the playbackdevice to the terminal device, and operations are easy and quick.

1104. The server sends the interaction information to the terminaldevice.

1105. The terminal device, when receiving the interaction information,outputs a multimedia display interface at least including the multimediaprogram information.

Referring to FIG. 11B, the multimedia display interface includes aplayback key of a multimedia program “Happy Camp, No. 45”, the userrelation chain of the second user ID includes head portraits “Headportrait 3” to “Head portrait 6” of user IDs where the “Happy Camp” hasbeen played, a “hot” option, a “related information” option and a“comment” key. The terminal device, when detecting a click operation onthe playback key, plays back the multimedia program “Happy Camp, No.45”, the terminal device, when detecting a click operation on the“related information” option, displays a message related to the program“Happy Camp”, and the terminal device, when detecting a click operationon the “comment” key, displays a comment input field, so that the userinputs a comment upon the multimedia program “Happy Camp, No. 45” intothe comment input field.

The method in the embodiment of the present invention takes that theinteraction information is multimedia program information as an example,the playback device can guide users to browse the multimedia programinformation each time the playback device plays back the multimediaprogram, thereby prolonging effective time, operations are easy, andinteraction efficiency is increased; moreover, the terminal device andthe playback device achieve dual-screen interaction, when users browsethe multimedia program information on the terminal device, the playbackdevice may continue to play back the multimedia program, continuity isstrong, and it is unnecessary to interrupt the process that the userswatch the multimedia program, thereby increasing the number of usersparticipating in the interaction and enhancing user viscosity. Further,when the multimedia program information includes the link address of themultimedia program, the terminal device can play back the multimediaprogram, thereby achieving projection of the multimedia program from theplayback device to the terminal device, and operations are easy andquick.

FIG. 12 is a schematic structural diagram of a terminal device accordingto one embodiment of the present invention. Referring to FIG. 12, theterminal device includes:

an image clip information acquisition module 1201, configured to acquireat least one image clip information of a multimedia program in a processof playing back the multimedia program;

an image clip information sending module 1202, configured to send theimage clip information, the image clip information being used formatching corresponding multimedia program information;

an interaction information receiving module 1203, configured to receiveinteraction information corresponding to the multimedia programinformation; and

an interaction module 1204, configured to output an interactiveinterface, to interact with the multimedia program based on aninteraction operation on the interactive interface.

According to the terminal device in the embodiment of the presentinvention, clip information of a multimedia program is acquired in aprocess of playing back the multimedia program, interaction informationcorresponding to the clip information is received, an interactiveinterface at least including the interaction information is outputaccording to the interaction information, and a user can perform aninteraction operation on the interactive interface to interact with theserver. As participation in interaction can be done by a simpleinteraction operation on the interactive interface, the operation iseasy, thereby improving interaction efficiency

The image clip information acquisition module 1201 includes:

a scanning unit, configured to scan a display screen where themultimedia program is played, to obtain the at least one image clipinformation of the multimedia program.

The interaction module 1204 includes:

a first interaction unit, configured to, when the interactioninformation includes multiple candidate options, output an interactiveinterface at least including the multiple candidate options, and when aselection operation on a specified candidate option in the interactiveinterface is detected, send the specified candidate option.

The interaction module 1204 includes:

a second interaction unit, configured to, when the interactioninformation includes prompt information, output an interactive interfaceat least including the prompt information and an input field, acquireresponse information input in the input field, and send the responseinformation.

The interaction module includes:

a third interaction unit, configured to, when the interactioninformation includes lottery information, output an interactiveinterface at least including the lottery information, receive a lotteryresult, and display the lottery result in the lottery interface.

The interaction module 1204 includes:

a fourth interaction unit, configured to, the interaction informationincludes a target value, output a target display interface at leastincluding the target value and an exchange option, if a click operationon the exchange option is detected, output a value transfer interface atleast including the target value and a value transfer option, and if aclick operation on the value transfer option is detected, send a valuetransfer request for the target; or

a fifth interaction unit, configured to, when the interactioninformation includes a target value, output a value transfer interfaceat least including the target value and a value transfer option, and ifa click operation on the value transfer option is detected, send a valuetransfer request for the target.

The interaction module 1204 includes:

a judgment unit, configured to, when the interaction information is afirst user ID and an instruction of calling an IM session window, judgewhether a user relation chain of a second user ID used by the terminaldevice includes the first user ID;

a sixth interaction unit, configured to, when the user relation chain ofthe second user ID includes the first user ID, output an interactiveinterface at least including an IM session window of the second user IDand the first user ID, acquire IM messages input in the IM sessionwindow, and send the IM messages based on the second user ID; or

a seventh interaction unit, configured to, when the user relation chainof the second user ID does not include the first user ID, output aninteractive interface at least including details information andattention option of the first user ID, and if a click operation on theattention option in the interactive interface is detected, send anattention request for the first user ID.

The interaction module 1204 includes:

an eighth interaction unit, configured to, when the interactioninformation is multimedia program information, output an interactiveinterface at least including the multimedia program information, theinteractive interface being configured to display the multimedia programinformation.

All the above optional technical solutions can form optional embodimentsof the present invention in any combination, which are not repeatedherein one by one.

It should be noted that, when the terminal device in the embodimentsinteracts with the server based on a multimedia program playbackprocess, illustration is given only according to division of thefunctional modules, and during actual applications, the functions can beassigned to and completed by different functional modules as required,that is, an internal structure of the terminal device is divided intodifferent functional modules, to complete all or some of the functions.In addition, the terminal device in the embodiments and the embodimentsof the interaction method based on multimedia programs belong to thesame concept, and reference can be made to the method embodiments forspecific implementation process thereof, which is not repeated herein.

FIG. 13 is a schematic structural diagram of a terminal device accordingto one embodiment of the present invention; FIG. 13 illustrates aschematic structural diagram of a terminal device having atouch-sensitive surface involved in an exemplary embodiment of thepresent invention, and the terminal device can be configured toimplement the functions performed by the terminal device in theinteraction method based on multimedia programs illustrated in theembodiments. Specifically:

The terminal device 1300 may include components such as a RadioFrequency (RF) circuit 110, a memory 120 including one or more computerreadable storage mediums, an input unit 130, a display unit 140, asensor 150, an audio circuit 160, a transmission module 170, a processor180 including one or more processing cores, and a power supply 1100. Aperson skilled in the art may understand that the structure of theterminal device shown in FIG. 13 does not constitute a limitation to theterminal device, and the terminal device may include more components orfewer components than those shown in the figure, or some components maybe combined, or a different component deployment may be used.

The RF circuit 110 may be configured to receive and send signals duringan information receiving and sending process or a call process.Particularly, the RF circuit 110 receives downlink information from abase station, then delivers the downlink information to the one or moreprocessors 180 for processing, and sends related uplink data to the basestation. Generally, the RF circuit 110 includes, but is not limited to,an antenna, at least one amplifier, a tuner, one or more oscillators, asubscriber identity module (SIM) card, a transceiver, a coupler, a lownoise amplifier (LNA), and a duplexer. In addition, the RF circuit 110may also communicate with a network and another device by wirelesscommunication. The wireless communication may use any communicationsstandard or protocol, which includes, but is not limited to, GlobalSystem for Mobile communications (GSM), General Packet Radio Service(GPRS), Code Division Multiple Access (CDMA), Wideband Code DivisionMultiple Access (WCDMA), Long Term Evolution (LTE), e-mail, ShortMessaging Service (SMS), and the like.

The memory 120 may be configured to store a software program and module,for example, the software program and module corresponding to theterminal device shown in the exemplary embodiment. The processor 180runs the software program and module stored in the memory 120, toimplement various functional applications and data processing, forexample, implement video-based interaction and the like. The memory 120may mainly include a program storage area and a data storage area. Theprogram storage area may store an operating system, an applicationprogram required by at least one function (such as a sound playbackfunction and an image display function), and the like. The data storagearea may store data (such as audio data and an address book) createdaccording to use of the terminal device 1300, and the like. In addition,the memory 120 may include a high speed random access memory, and mayalso include a non-volatile memory, such as at least one magnetic diskstorage device, a flash memory, or another volatile solid-state storagedevice. Correspondingly, the memory 120 may further include a memorycontroller, so as to provide access of the processor 180 and the inputunit 130 to the memory 120.

The input unit 130 may be configured to receive input digit or characterinformation, and generate a keyboard, mouse, joystick, optical, or trackball signal input related to the user setting and function control.Specifically, the input unit 130 may include a touch-sensitive surface131 and another input device 132. The touch-sensitive surface 131, whichmay also be referred to as a touch screen or a touch panel, may collecta touch operation of a user on or near the touch-sensitive surface (suchas an operation of a user on or near the touch-sensitive surface 131 byusing any suitable object or accessory, such as a finger or a stylus),and drive a corresponding connection apparatus according to a presetprogram. Optionally, the touch-sensitive surface 131 may include twoparts: a touch detection apparatus and a touch controller. The touchdetection apparatus detects a touch position of the user, detects asignal generated by the touch operation, and transfers the signal to thetouch controller. The touch controller receives the touch informationfrom the touch detection apparatus, converts the touch information intotouch point coordinates, and sends the touch point coordinates to theprocessor 180. Moreover, the touch controller can receive and execute acommand sent from the processor 180. In addition, the touch-sensitivesurface 131 may be may be a resistive, capacitive, infrared, or surfacesound wave type touch-sensitive surface. In addition to thetouch-sensitive surface 131, the input unit 130 may further include theanother input device 132. Specifically, the another input device 132 mayinclude, but is not limited to, one or more of a physical keyboard, afunctional key (such as a volume control key or a switch key), a trackball, a mouse, and a joystick.

The display unit 140 may be configured to display information input bythe user or information provided for the user, and various graphicaluser interfaces of the terminal device 1300. The graphical userinterfaces may be formed by a graph, a text, an icon, a video, or anycombination thereof. The display unit 140 may include a display panel141. Optionally, the display panel 141 may be configured by using aliquid crystal display (LCD), an organic light-emitting diode (OLED), orthe like. Further, the touch-sensitive surface 131 may cover the displaypanel 141. After detecting a touch operation on or near thetouch-sensitive surface 131, the touch-sensitive surface 131 transfersthe touch operation to the processor 180, so as to determine the type ofthe touch event. Then, the processor 180 provides a corresponding visualoutput on the display panel 141 according to the type of the touchevent. Although, in FIG. 13, the touch-sensitive surface 131 and thedisplay panel 141 are used as two separate parts to implement input andoutput functions, in some embodiments, the touch-sensitive surface 131and the display panel 141 may be integrated to implement the input andoutput functions.

The terminal device 1300 may further include at least one sensor 150,such as an optical sensor, a motion sensor, and other sensors.Specifically, the optical sensor may include an ambient light sensor anda proximity sensor. The ambient light sensor can adjust luminance of thedisplay panel 141 according to brightness of the ambient light. Theproximity sensor may switch off the display panel 141 and/or backlightwhen the terminal device 1300 is moved to the ear. As one type of motionsensor, a gravity acceleration sensor can detect magnitude ofaccelerations in various directions (generally on three axes), maydetect magnitude and a direction of the gravity when static, and may beapplied to an application that recognizes the attitude of the mobilephone (for example, switching between landscape orientation and portraitorientation, a related game, and magnetometer attitude calibration), afunction related to vibration recognition (such as a pedometer and aknock), and the like. Other sensors, such as a gyroscope, a barometer, ahygrometer, a thermometer, and an infrared sensor, which may beconfigured in the terminal device 1300, are not further describedherein.

The audio circuit 160, a loudspeaker 161, and a microphone 162 mayprovide audio interfaces between the user and the terminal device 1300.The audio circuit 160 may convert received audio data into an electricsignal and transmit the electric signal to the loudspeaker 161. Theloudspeaker 161 converts the electric signal into a sound signal foroutput. On the other hand, the microphone 162 converts a collected soundsignal into an electric signal. The audio circuit 160 receives theelectric signal and converts the electric signal into audio data, andoutputs the audio data to the processor 180 for processing. Then, theprocessor 180 sends the audio data to, for example, another terminaldevice by using the RF circuit 110, or outputs the audio data to thememory 120 for further processing. The audio circuit 160 may furtherinclude an earplug jack, so as to provide communication between aperipheral earphone and the terminal device 1300.

The terminal device 1300 may help, by using the transmission module 170,the user to receive and send e-mails, browse a webpage, access streamingmedia, and so on, which provides wireless broadband Internet access forthe user. Although FIG. 13 shows the transmission module 170, it may beunderstood that the transmission module is not a necessary component ofthe terminal device 1300, and when required, the transmission module maybe omitted as long as the scope of the essence of the present disclosureis not changed.

The processor 180 is the control center of the terminal device 1300, andis connected to various parts of the mobile phone by using variousinterfaces and lines. By running or executing the software programand/or module stored in the memory 120, and invoking data stored in thememory 120, the processor 180 performs various functions and dataprocessing of the terminal device 1300, thereby performing overallmonitoring on the mobile phone. Optionally, the processor 180 mayinclude one or more processing cores; the processor 180 may integrate anapplication processor and a modem. The application processor mainlyprocesses an operating system, a user interface, an application program,and the like. The modem mainly processes wireless communication. It maybe understood that the foregoing modem may also not be integrated intothe processor 180.

The terminal device 1300 further includes the power supply 1100 (such asa battery) for supplying power to the components. Preferably, the powersupply may be logically connected to the processor 180 by using a powermanagement system, thereby implementing functions such as charging,discharging and power consumption management by using the powermanagement system. The power supply 1100 may further include one or moreof a direct current or alternating current power supply, a re-chargingsystem, a power failure detection circuit, a power supply converter orinverter, a power supply state indicator, and any other components.

Although not shown in the figure, the terminal device 1300 may furtherinclude a camera, a Bluetooth module, and the like, which are notfurther described herein. Specifically, in this embodiment, the displayunit of the terminal device is a touch screen display, and the terminaldevice further includes a memory and one or more programs. The one ormore programs are stored in the memory and configured to be executed byone or more processors. The one or more programs contain instructionsused for implementing the following operations:

acquiring at least one image clip information of a multimedia program ina process of playing back the multimedia program;

sending the image clip information, the image clip information beingused for matching corresponding multimedia program information;

receiving interaction information corresponding to the multimediaprogram information; and

outputting an interactive interface, to interact with the multimediaprogram based on an interaction operation on the interactive interface.

The memory of the terminal device further includes an instruction usedfor implementing the following operation:

scanning a display screen where the multimedia program is played, toobtain the at least one image clip information of the multimediaprogram.

The memory of the terminal device further includes an instruction usedfor implementing the following operation:

when the interaction information includes multiple candidate options,outputting an interactive interface at least including the multiplecandidate options, and when a selection operation on a specifiedcandidate option in the interactive interface is detected, sending thespecified candidate option.

The memory of the terminal device further includes an instruction usedfor implementing the following operation:

when the interaction information includes prompt information, outputtingan interactive interface at least including the prompt information andan input field, acquiring response information input in the input field,and sending the response information.

The memory of the terminal device further includes an instruction usedfor implementing the following operation:

when the interaction information includes lottery information,outputting an interactive interface at least including the lotteryinformation, receiving a lottery result, and displaying the lotteryresult in the lottery interface.

The memory of the terminal device further includes an instruction usedfor implementing the following operations:

when the interaction information includes a target value, outputting atarget display interface at least including the target value and anexchange option, if a click operation on the exchange option isdetected, outputting a value transfer interface at least including thetarget value and a value transfer option, and if a click operation onthe value transfer option is detected, sending a value transfer requestfor the target; or

when the interaction information includes a target value, outputting avalue transfer interface at least including the target value and a valuetransfer option, and if a click operation on the value transfer optionis detected, sending a value transfer request for the target.

The memory of the terminal device further includes an instruction usedfor implementing the following operations:

when the interaction information is a first user ID and an instructionof calling an IM session window, judging whether a user relation chainof a second user ID used by the terminal device includes the first userID;

when the user relation chain of the second user ID includes the firstuser ID, outputting an interactive interface at least including an IMsession window of the second user ID and the first user ID, acquiring IMmessages input in the IM session window, and sending the IM messagesbased on the second user ID; or

when the user relation chain of the second user ID does not include thefirst user ID, outputting an interactive interface at least includingdetails information and attention option of the first user ID, and if aclick operation on the attention option in the interactive interface isdetected, sending an attention request for the first user ID.

The memory of the terminal device further includes an instruction usedfor implementing the following operations:

when the interaction information is multimedia program information,outputting an interactive interface at least including the multimediaprogram information, the interactive interface being configured todisplay the multimedia program information.

All the above optional technical solutions can form optional embodimentsof the present invention in any combination, which are not repeatedherein one by one.

FIG. 14 is a schematic structural diagram of a server according to oneembodiment of the present invention; referring to FIG. 14, the serverincludes:

an image clip information receiving module 1401, configured to receiveimage clip information of a multimedia program, the image clipinformation being acquired in a process of playing back the multimediaprogram;

a program information determination module 1402, configured to determinemultimedia program information matching the image clip informationaccording to the image clip information;

an interaction information acquisition module 1403, configured toacquire interaction information corresponding to the image clipinformation; and

an interaction information sending module 1404, configured to send theinteraction information.

According to the server in the embodiment of the present invention, theserver, when receiving clip information sent by a terminal device,returns interaction information corresponding to the clip information tothe terminal device, and a user can interact with the server on theterminal device according to the interaction information. Asparticipation in interaction can be done by a simple interactionoperation on the interactive interface, the operation is easy, therebyimproving interaction efficiency.

The program information determination module 1402 includes:

a program information determination unit, configured to traverse imageinformation of each multimedia program stored, determine imageinformation matching the image clip information, and determinemultimedia program information of the matched image information.

The server further includes:

a screenshot module, configured to take a screenshot of each multimediaprogram, to obtain a plurality of image information.

The server further includes:

a first interaction module, configured to, when the interactioninformation includes multiple candidate options, if a specifiedcandidate option is received, increase the number of the specifiedcandidate option; or a second interaction module, configured to, whenthe interaction information includes multiple candidate options, if aspecified candidate option is received, judge whether the specifiedcandidate option is correct, and send virtual reward data according to ajudgment result.

The server further includes:

a third interaction module, configured to, when the interactioninformation includes prompt information, if response information isreceived, judge whether the response information is correct, and sendvirtual reward data according to a judgment result; or

a fourth interaction module, configured to, when the interactioninformation includes prompt information, if response information isreceived, release the response information; or

a fifth interaction module, configured to, when the interactioninformation is lottery information, acquire a lottery resultcorresponding to the lottery information, and send the lottery result.

The server further includes:

a sixth interaction module, configured to, when the interactioninformation includes a target value, if a value transfer request for thetarget is received, perform a value transfer operation according to thevalue, account information corresponding to the target and accountinformation corresponding to a terminal device that sends the valuetransfer request.

The server further includes:

a seventh interaction module, configured to, when the interactioninformation is a first user ID and an instruction of calling an IMsession window, if an IM message is received, send the IM message to aterminal device where the first user ID is; or

an eighth interaction module, configured to, when the interactioninformation is a first user ID and an instruction of calling an IMsession window, if an attention request sent by a terminal device isreceived, add the first user ID to a user relation chain of the terminaldevice.

All the above optional technical solutions can form optional embodimentsof the present invention in any combination, which are not repeatedherein one by one.

It should be noted that, when the server in the embodiments interactswith the terminal device based on a multimedia program playback process,illustration is given only according to division of the functionalmodules, and during actual applications, the functions can be assignedto and completed by different functional modules as required, that is,an internal structure of the server is divided into different functionalmodules, to complete all or some of the functions. In addition, theserver in the embodiments and the embodiments of the interaction methodbased on multimedia programs belong to the same concept, and referencecan be made to the method embodiments for specific implementationprocess thereof, which is not repeated herein.

FIG. 15 is a schematic structural diagram of a server according to oneembodiment of the present invention; the server can be configured toimplement the functions performed by the server in the interactionmethod based on multimedia programs illustrated in the embodiments.Specifically, referring to FIG. 15, the server 1500 may vary greatly dueto different configuration or performance, and may include one or morecentral processing units (CPUs) 1522 (for example, one or moreprocessors) and a memory 1532, one or more storage mediums 1530 (forexample, one or more mass storage devices) that store an application1542 or data 1544. The memory 1532 and the storage mediums 1530 may betemporary storage or permanent storage. The program stored in thestorage mediums 1530 may include one or more modules (not shown).

The server 1500 may further include one or more power sources 1526, oneor more wired or wireless network interfaces 1550, one or moreinput/output interfaces 1558, and/or one or more operating systems 1541,for example, Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™ and thelike.

One or more programs are stored in the memory, and are configured to beperformed by one or more processors, the one or more programs containinginstructions used for performing the following operations:

receiving image clip information of a multimedia program, the image clipinformation being acquired in a process of playing back the multimediaprogram;

determining multimedia program information matching the image clipinformation according to the image clip information;

acquiring interaction information corresponding to the multimediaprogram information; and

sending the interaction information.

An instruction used for performing the following operation is furtherincluded:

traversing image information of each multimedia program stored,determining the image information matching the image clip information,and determining multimedia program information of the matched imageinformation.

An instruction used for performing the following operation is furtherincluded:

taking a screenshot of each multimedia program, to obtain a plurality ofimage information.

An instruction used for performing the following operation is furtherincluded:

when the interaction information includes multiple candidate options, ifa specified candidate option is received, increasing the number of thespecified candidate option; or when the interaction information includesmultiple candidate options, if a specified candidate option is received,judging whether the specified candidate option is correct, and sendingvirtual reward data according to a judgment result.

An instruction used for performing the following operation is furtherincluded:

when the interaction information includes prompt information, ifresponse information is received, judging whether the responseinformation is correct, and sending virtual reward data according to ajudgment result; or

when the interaction information includes prompt information, ifresponse information is received, releasing the response information; or

when the interaction information is lottery information, acquiring alottery result corresponding to the lottery information, and sending thelottery information.

An instruction used for performing the following operation is furtherincluded:

when the interaction information includes a target value, if a valuetransfer request for the target is received, performing a value transferoperation according to the value, account information corresponding tothe target and account information corresponding to a terminal devicethat sends the value transfer request.

An instruction used for performing the following operation is furtherincluded:

when the interaction information is a first user ID and an instructionof calling an IM session window, if an IM message is received, sendingthe IM message to a terminal device where the first user ID is located;or

when the interaction information is a first user ID and an instructionof calling an IM session window, if an attention request sent by aterminal device is received, adding the first user ID to a user relationchain of the terminal device.

All the above optional technical solutions can form optional embodimentsof the present invention in any combination, which are not repeatedherein one by one.

FIG. 16 is a schematic structural diagram of an interaction system basedon multimedia programs according to one embodiment of the presentinvention; referring to FIG. 16, the system includes: a terminal device1601 and a server 1602;

the terminal device 1601 is configured to acquire at least one imageclip information of a multimedia program in a process of playing backthe multimedia program;

the terminal device 1601 is further configured to send the image clipinformation to the server 1602, the image clip information being usedfor matching corresponding multimedia program information;

the server 1602 is configured to, when receiving the image clipinformation, determine multimedia program information matching the imageclip information according to the image clip information, and acquireinteraction information corresponding to the multimedia programinformation;

the server 1602 is further configured to send the interactioninformation to the terminal device 1601; and

the terminal device 1601 is further configured to, when receiving theinteraction information, output an interactive interface, and interactwith the multimedia program based on an interaction operation on theinteractive interface.

The terminal device 1601 is further configured to scan a display screenwhere the multimedia program is played, to obtain the at least one imageclip information of the multimedia program.

The server 1602 is further configured to traverse image information ofeach multimedia program stored, determine the image information matchingthe image clip information, and determine multimedia program informationof the matched image information.

The server 1602 is further configured to take a screenshot of eachmultimedia program, to obtain a plurality of image information.

All the above optional technical solutions can form optional embodimentsof the present invention in any combination, which are not repeatedherein one by one.

A person of ordinary skill in the art may understand that all or some ofthe steps of the foregoing embodiments may be implemented by usinghardware, or may be implemented by a program instructing relevanthardware. The program may be stored in a computer readable storagemedium. The storage medium may be a read-only memory, a magnetic disk,an optical disc, or the like.

The foregoing descriptions are merely preferred embodiments of thepresent invention, but are not intended to limit the present disclosure.Any modification, equivalent replacement, or improvement made within thespirit and principle of the present disclosure shall fall within theprotection scope of the present disclosure.

What is claimed is:
 1. An interaction method based on multimediaprograms, running in a terminal device, the terminal device comprising amemory and one or more processors, and a program instruction beingstored in the memory and executed by the one or more processors, themethod comprising: acquiring at least one image clip information of amultimedia program in a process of playing back the multimedia program;sending the image clip information, the image clip information beingused for matching corresponding multimedia program information;receiving interaction information corresponding to the multimediaprogram information; and outputting an interactive interface, tointeract with the multimedia program based on an interaction operationon the interactive interface.
 2. The method according to claim 1,wherein the acquiring at least one image clip information of amultimedia program comprises: scanning a display screen where themultimedia program is played, to obtain the at least one image clipinformation of the multimedia program.
 3. The method according to claim1, wherein the outputting an interactive interface, to interact with themultimedia program based on an interaction operation on the interactiveinterface comprises: when the interaction information comprises multiplecandidate options, outputting an interactive interface at leastcomprising the multiple candidate options, and when a selectionoperation on a specified candidate option in the interactive interfaceis detected, sending the specified candidate option.
 4. The methodaccording to claim 1, wherein the outputting an interactive interface,to interact with the multimedia program based on an interactionoperation on the interactive interface comprises: when the interactioninformation comprises prompt information, outputting an interactiveinterface at least comprising the prompt information and an input field,acquiring response information input in the input field, and sending theresponse information.
 5. The method according to claim 1, wherein theoutputting an interactive interface, to interact with the multimediaprogram based on an interaction operation on the interactive interfacecomprises: when the interaction information comprises lotteryinformation, outputting an interactive interface at least comprising thelottery information, receiving a lottery result, and displaying thelottery result in the lottery interface.
 6. The method according toclaim 1, wherein the outputting an interactive interface, to interactwith the multimedia program based on an interaction operation on theinteractive interface comprises: when the interaction informationcomprises a target value, outputting a target display interface at leastcomprising the target value and an exchange option, if a click operationon the exchange option is detected, outputting a value transferinterface at least comprising the target value and a value transferoption, and if a click operation on the value transfer option isdetected, sending a value transfer request for the target; or when theinteraction information comprises a target value, outputting a valuetransfer interface at least comprising the target value and a valuetransfer option, and if a click operation on the value transfer optionis detected, sending a value transfer request for the target.
 7. Themethod according to claim 1, wherein the outputting an interactiveinterface, to interact with the multimedia program based on aninteraction operation on the interactive interface comprises: when theinteraction information is a first user ID and an instruction of callingan instant messaging (IM) session window, judging whether a userrelation chain of a second user ID used by the terminal device comprisesthe first user ID; when the user relation chain of the second user IDcomprises the first user ID, outputting an interactive interface atleast comprising an IM session window of the second user ID and thefirst user ID, acquiring IM messages input in the IM session window, andsending the IM messages based on the second user ID; or when the userrelation chain of the second user ID does not comprise the first userID, outputting an interactive interface at least comprising detailsinformation and an attention option of the first user ID, and if a clickoperation on the attention option in the interactive interface isdetected, sending an attention request for the first user ID.
 8. Themethod according to claim 1, wherein the outputting an interactiveinterface, to interact with the multimedia program based on aninteraction operation on the interactive interface comprises: when theinteraction information is multimedia program information, outputting aninteractive interface at least comprising the multimedia programinformation, the interactive interface being configured to display themultimedia program information.
 9. An interaction method based onmultimedia programs, running in a server, the server comprising a memoryand one or more processors, and a program instruction being stored inthe memory and executed by the one or more processors, the methodcomprising: receiving image clip information of a multimedia program,the image clip information being acquired in a process of playing backthe multimedia program; determining multimedia program informationmatching the image clip information according to the image clipinformation; acquiring interaction information corresponding to themultimedia program information; and sending the interaction information.10. The method according to claim 9, wherein the determining multimediaprogram information matching the image clip information according to theimage clip information comprises: traversing image information of eachmultimedia program stored, determining the image information matchingthe image clip information, and determining multimedia programinformation of the matched image information.
 11. The method accordingto claim 10, wherein, before the determining multimedia programinformation matching the image clip information according to the imageclip information, the method further comprises: taking a screenshot ofeach multimedia program, to obtain a plurality of image information. 12.The method according to claim 9, wherein, after the sending theinteraction information, the method further comprises: when theinteraction information comprises multiple candidate options, if aspecified candidate option is received, increasing the number of thespecified candidate option; or when the interaction informationcomprises multiple candidate options, if a specified candidate option isreceived, judging whether the specified candidate option is correct, andsending virtual reward data according to a judgment result.
 13. Themethod according to claim 9, wherein, after the sending the interactioninformation, the method further comprises: when the interactioninformation comprises prompt information, if response information isreceived, judging whether the response information is correct, andsending virtual reward data according to a judgment result; or when theinteraction information comprises prompt information, if responseinformation is received, releasing the response information; or when theinteraction information is lottery information, acquiring a lotteryresult corresponding to the lottery information, and sending the lotteryinformation.
 14. The method according to claim 9, wherein, after thesending the interaction information, the method further comprises: whenthe interaction information comprises a target value, if a valuetransfer request for the target is received, performing a value transferoperation according to the value, account information corresponding tothe target and account information corresponding to a terminal devicethat sends the value transfer request.
 15. The method according to claim9, wherein, after the sending the interaction information, the methodfurther comprises: when the interaction information is a first user IDand an instruction of calling an instant messaging (IM) session window,if an IM message is received, sending the IM message to a terminaldevice where the first user ID is; or when the interaction informationis a first user ID and an instruction of calling an IM session window,if an attention request sent by a terminal device is received, addingthe first user ID to a user relation chain of the terminal device.
 16. Aterminal device, comprising: a memory; one or more processors; one ormore program modules stored in the memory and executed by the one ormore processors, the one or more program modules comprising: an imageclip information acquisition module, configured to acquire at least oneimage clip information of a multimedia program in a process of playingback the multimedia program; an image clip information sending module,configured to send the image clip information, the image clipinformation being used for matching corresponding multimedia programinformation; an interaction information receiving module, configured toreceive interaction information corresponding to the multimedia programinformation; and an interaction module, configured to output aninteractive interface, to interact with the multimedia program based onan interaction operation on the interactive interface.
 17. The terminaldevice according to claim 16, wherein the image clip informationacquisition module comprises: a scanning unit, configured to scan adisplay screen where the multimedia program is played, to obtain the atleast one image clip information of the multimedia program.
 18. Theterminal device according to claim 16, wherein the interaction modulecomprises: a first interaction unit, configured to, when the interactioninformation comprises multiple candidate options, output an interactiveinterface at least comprising the multiple candidate options, and when aselection operation on a specified candidate option in the interactiveinterface is detected, send the specified candidate option.
 19. Theterminal device according to claim 16, wherein the interaction modulecomprises: a second interaction unit, configured to, when theinteraction information comprises prompt information, output aninteractive interface at least comprising the prompt information and aninput field, acquire response information input in the input field, andsend the response information.
 20. The terminal device according toclaim 16, wherein the interaction module comprises: a third interactionunit, configured to, when the interaction information comprises lotteryinformation, output an interactive interface at least comprising thelottery information, receive a lottery result, and display the lotteryresult in the lottery interface.
 21. The terminal device according toclaim 16, wherein the interaction module comprises: a fourth interactionunit, configured to, when the interaction information comprises a targetvalue, output a target display interface at least comprising the targetvalue and an exchange option, if a click operation on the exchangeoption is detected, output a value transfer interface at leastcomprising the target value and a value transfer option, and if a clickoperation on the value transfer option is detected, send a valuetransfer request for the target; or a fifth interaction unit, configuredto, when the interaction information comprises a target value, output avalue transfer interface at least comprising the target value and avalue transfer option, and if a click operation on the value transferoption is detected, send a value transfer request for the target. 22.The terminal device according to claim 16, wherein the interactionmodule comprises: a judgment unit, configured to, when the interactioninformation is a first user ID and an instruction of calling an instantmessaging (IM) session window, judge whether a user relation chain of asecond user ID used by the terminal device comprises the first user ID;a sixth interaction unit, configured to, when the user relation chain ofthe second user ID comprises the first user ID, output an interactiveinterface at least comprising an IM session window of the second user IDand the first user ID, acquire IM messages input in the IM sessionwindow, and send the IM messages based on the second user ID; or aseventh interaction unit, configured to, when the user relation chain ofthe second user ID does not comprise the first user ID, output aninteractive interface at least comprising details information and anattention option of the first user ID, and if a click operation on theattention option in the interactive interface is detected, send anattention request for the first user ID.
 23. The terminal deviceaccording to claim 16, wherein the interaction module comprises: aneighth interaction unit, configured to, when the interaction informationis multimedia program information, output an interactive interface atleast comprising the multimedia program information, the interactiveinterface being configured to display the multimedia programinformation.